-- Logs begin at Thu 2022-09-01 15:49:54 UTC, end at Thu 2022-09-01 16:56:44 UTC. -- Sep 01 16:27:44.089008 dv-cinder-852210-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 01 16:27:44.097752 dv-cinder-852210-9-iscsi devstack@n-api.service[105737]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 01 16:27:44.099783 dv-cinder-852210-9-iscsi devstack@n-api.service[105737]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 16:27:44 2022] *** Sep 01 16:27:44.099783 dv-cinder-852210-9-iscsi devstack@n-api.service[105737]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 16:27:44.099783 dv-cinder-852210-9-iscsi devstack@n-api.service[105737]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 16:27:44.099783 dv-cinder-852210-9-iscsi devstack@n-api.service[105737]: nodename: dv-cinder-852210-9-iscsi Sep 01 16:27:44.099783 dv-cinder-852210-9-iscsi devstack@n-api.service[105737]: machine: x86_64 Sep 01 16:27:44.099783 dv-cinder-852210-9-iscsi devstack@n-api.service[105737]: clock source: unix Sep 01 16:27:44.099783 dv-cinder-852210-9-iscsi devstack@n-api.service[105737]: pcre jit disabled Sep 01 16:27:44.099783 dv-cinder-852210-9-iscsi devstack@n-api.service[105737]: detected number of CPU cores: 4 Sep 01 16:27:44.099783 dv-cinder-852210-9-iscsi devstack@n-api.service[105737]: current working directory: / Sep 01 16:27:44.099783 dv-cinder-852210-9-iscsi devstack@n-api.service[105737]: detected binary path: /usr/bin/uwsgi-core Sep 01 16:27:44.100466 dv-cinder-852210-9-iscsi devstack@n-api.service[105737]: your processes number limit is 47680 Sep 01 16:27:44.100466 dv-cinder-852210-9-iscsi devstack@n-api.service[105737]: your memory page size is 4096 bytes Sep 01 16:27:44.100466 dv-cinder-852210-9-iscsi devstack@n-api.service[105737]: detected max file descriptor number: 2048 Sep 01 16:27:44.100466 dv-cinder-852210-9-iscsi devstack@n-api.service[105737]: lock engine: pthread robust mutexes Sep 01 16:27:44.100466 dv-cinder-852210-9-iscsi devstack@n-api.service[105737]: thunder lock: enabled Sep 01 16:27:44.100466 dv-cinder-852210-9-iscsi devstack@n-api.service[105737]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 01 16:27:44.100466 dv-cinder-852210-9-iscsi devstack@n-api.service[105737]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 16:27:44.138538 dv-cinder-852210-9-iscsi devstack@n-api.service[105737]: Python main interpreter initialized at 0x55b9928ad9c0 Sep 01 16:27:44.138538 dv-cinder-852210-9-iscsi devstack@n-api.service[105737]: python threads support enabled Sep 01 16:27:44.138538 dv-cinder-852210-9-iscsi devstack@n-api.service[105737]: your server socket listen backlog is limited to 100 connections Sep 01 16:27:44.138538 dv-cinder-852210-9-iscsi devstack@n-api.service[105737]: your mercy for graceful operations on workers is 90 seconds Sep 01 16:27:44.138940 dv-cinder-852210-9-iscsi devstack@n-api.service[105737]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 16:27:44.138940 dv-cinder-852210-9-iscsi devstack@n-api.service[105737]: *** Operational MODE: preforking *** Sep 01 16:27:44.139243 dv-cinder-852210-9-iscsi devstack@n-api.service[105737]: *** uWSGI is running in multiple interpreter mode *** Sep 01 16:27:44.139243 dv-cinder-852210-9-iscsi devstack@n-api.service[105737]: spawned uWSGI master process (pid: 105737) Sep 01 16:27:44.139477 dv-cinder-852210-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 01 16:27:44.144263 dv-cinder-852210-9-iscsi devstack@n-api.service[105737]: spawned uWSGI worker 1 (pid: 105740, cores: 1) Sep 01 16:27:44.144263 dv-cinder-852210-9-iscsi devstack@n-api.service[105737]: spawned uWSGI worker 2 (pid: 105741, cores: 1) Sep 01 16:27:44.144263 dv-cinder-852210-9-iscsi devstack@n-api.service[105737]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 16:27:44.796221 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 16:27:44.802536 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 16:27:45.872101 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:27:45.872101 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: from cryptography.utils import int_from_bytes Sep 01 16:27:45.872698 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:27:45.872698 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: from cryptography.utils import int_from_bytes Sep 01 16:27:45.888136 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:27:45.888136 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: from cryptography.utils import int_from_bytes Sep 01 16:27:45.888668 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:27:45.888668 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: from cryptography.utils import int_from_bytes Sep 01 16:27:48.342427 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 16:27:48.343026 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 16:27:48.343184 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 16:27:48.343566 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 16:27:48.343821 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 16:27:48.344231 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.344560 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.344879 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 16:27:48.345285 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.345384 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 16:27:48.345456 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.345456 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.345711 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 16:27:48.345846 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.346019 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 16:27:48.346168 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.346256 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 16:27:48.346421 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.346637 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.346762 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.346933 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.347013 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.347280 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.347414 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.347580 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.347695 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-9-iscsi {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.347920 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.348010 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.348216 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.348307 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.348525 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.348630 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.348837 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.348925 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.349139 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.349241 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.349398 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.349502 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.349713 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.349818 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.350044 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-9-iscsi {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.350227 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.350348 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.351416 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.351552 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.351668 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.351801 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.351918 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.352022 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.352227 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.352316 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.352445 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.352582 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.352697 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.352837 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.352837 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.353037 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.353172 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.353282 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.353366 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.353501 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.353592 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.353888 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-9-iscsi {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.353988 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.354203 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.354300 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.354519 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.354608 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.354830 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.354922 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.355139 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.355248 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.355468 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.355576 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.355793 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.355917 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.356129 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.356219 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.356483 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.356631 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-9-iscsi {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.356793 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.356931 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.357118 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.357211 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.357430 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.357518 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.357749 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.357851 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.358067 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.358156 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.358372 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.358462 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.358681 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.358787 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.358988 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.359078 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.359305 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.359396 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.359614 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.359726 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.359933 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.360025 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.360188 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.360278 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.360508 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.360609 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.360819 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.360911 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.361139 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.361229 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.361446 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.361536 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.361699 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.361861 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.361996 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.362170 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.362266 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.362478 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.362615 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.362753 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.362867 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.363022 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.363177 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.363345 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.363484 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.363668 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.363793 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.364017 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.364108 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.364271 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.364417 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.364529 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.364724 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.364846 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.365031 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.365165 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.365351 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.365473 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.365667 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.365782 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.365988 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.366083 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.366297 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.366383 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.366618 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.366713 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.366962 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.367053 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.367249 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.367346 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.367557 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.367653 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.367951 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.368104 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.368271 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.368535 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.368623 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.368870 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.368956 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.369195 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.369288 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.369489 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.369575 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.369796 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.369886 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.370102 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.370202 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.370421 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.370515 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.370752 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.370836 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.371054 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.371148 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.371304 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.371392 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.371608 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.371701 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.371930 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.372034 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.372252 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.372340 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.372557 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.372660 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.372866 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.373033 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.373170 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.373255 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.373470 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.373564 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.373777 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.373872 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.374026 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.374120 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.374333 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.374418 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.374638 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.374725 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.374956 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.375047 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.375260 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.375353 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.375561 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.375647 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.375862 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.376022 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.376185 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.376285 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.376487 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.376573 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.376790 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.376873 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.377106 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.377210 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.377414 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.377504 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.377717 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.377813 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.378021 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.378116 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.378326 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.378413 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.378645 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.378730 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.378950 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.379041 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.379254 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.379340 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.379568 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.379660 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.379869 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.379987 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.380193 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.380281 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.380496 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.380598 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.380801 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.380888 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.381109 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.381196 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.381424 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.381508 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.381726 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.381813 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.382028 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.382120 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.382342 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.382425 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.382642 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.382739 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.382945 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.383030 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.383246 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.383423 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.383665 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.383867 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.384040 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.384340 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.384426 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.384646 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.384739 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.384953 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.385041 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.385255 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.385340 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.385573 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.385671 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.385881 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.385974 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.386189 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.386279 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.386493 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.386586 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.386797 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.386881 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.387100 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.387235 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.387404 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.387499 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.387708 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.387793 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.388037 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.388129 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.388340 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.388443 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.388656 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.388742 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.388978 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.389064 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.389289 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.389383 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.389595 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.389694 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.389900 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.390052 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.390217 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:27:48.390389 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.390552 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.390702 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.390884 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.391015 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.391228 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.391316 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.391545 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.391630 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.391877 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.391981 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.392234 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.392323 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.392556 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.392641 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.392871 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.392971 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.393187 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.393298 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.393498 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.393584 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.393813 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.393897 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.394125 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.394225 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.394442 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.394540 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.394754 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.394840 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.395070 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.395155 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.395402 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.395488 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.395722 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.395818 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.396063 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.396150 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.396385 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.396469 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.396693 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.396790 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.397003 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.397095 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.397313 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.397398 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.397633 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.397736 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.397942 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.398028 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.398257 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.398354 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.398576 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.398679 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.398891 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.398994 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.399391 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.399711 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.399822 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.400057 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.400146 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.400371 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.400457 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.400684 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.400783 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.400995 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.401079 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.401328 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.401421 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.401640 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.401735 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.401956 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.402042 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.402268 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.402352 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.402577 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.402674 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.402892 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.402991 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.403201 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.403293 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.403509 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.403602 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.403818 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.403930 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.404147 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.404245 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.404453 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.404539 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.404757 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.404849 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.405067 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.405154 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.405374 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.405518 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.405693 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.405777 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.406002 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.406095 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.406306 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.406399 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.406614 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.406698 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.406922 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.407023 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.407229 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.407313 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.407531 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.407647 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.407834 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.407957 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.408182 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.408267 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.408494 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.408579 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.408802 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.409004 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.409130 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.409218 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.409414 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.409500 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.409720 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.409816 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.410025 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.410146 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.410344 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.410431 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.410650 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.410737 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.410955 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.411039 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.411268 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.411353 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.411575 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.411672 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.411923 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.412012 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.412215 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.412302 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.412518 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.412604 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.412841 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.412927 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.413149 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.413237 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.413454 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.413556 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.413773 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.413860 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.414077 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.414173 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.414385 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.414484 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.414843 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.414942 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.415174 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.415318 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.415532 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.415778 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.415932 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.416121 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.416253 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.416435 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.416562 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.416765 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.416859 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.417080 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.417166 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.417393 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.417521 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.417730 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.417816 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.418035 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.418132 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.418342 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.418429 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.418647 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.418732 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.418952 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.419052 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.419276 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.419370 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.419578 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.419663 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.419881 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.419992 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.420208 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.420300 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.420512 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.420600 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.420818 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.420956 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.421127 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.421213 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.421431 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.421516 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.421736 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.421824 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.422039 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.422131 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.422342 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.422428 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.422644 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.422732 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.422969 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.423063 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.423280 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.423409 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.423577 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.423661 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.423916 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.424004 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.424232 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.424318 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.424552 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.424640 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.424865 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.424952 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.425186 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.425272 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.425496 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.425583 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.425819 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.425905 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.426131 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.426226 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.426450 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.426535 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.426755 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.426847 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.427070 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.427168 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.427391 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.427483 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.427704 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.427872 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.428040 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.428141 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.428361 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.428455 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.428671 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.428766 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.428986 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.429080 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.429293 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.429377 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.429603 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.429694 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.429912 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.430008 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.430289 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.430410 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.430739 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.430838 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.431136 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.431224 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.431368 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.431564 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.431685 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.431926 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.432076 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.432252 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.432352 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.432576 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.432671 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.432890 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.432999 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.433206 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.433310 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.433516 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.433617 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.433826 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.433932 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.434138 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.434230 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.434449 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.434541 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.434773 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.434873 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.435083 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.435175 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.435396 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.435496 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.435702 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.435794 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.436031 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.436135 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.436337 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.436437 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.436645 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.436737 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.436946 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.437037 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.437259 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.437352 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.437566 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.437665 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.437873 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.437984 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.438189 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.438290 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.438499 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.438583 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.438799 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.438891 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.439105 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.439200 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.439415 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.439501 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.439727 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.439813 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.440055 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.440164 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.440362 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.440450 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.440673 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.440759 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.440976 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.441108 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.441283 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.441376 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.441594 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.441680 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.441900 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.441987 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.442203 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.442288 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.442511 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.442610 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.442816 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.442901 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.443117 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.443272 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.443429 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.443531 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.443745 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.443842 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.444074 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.444161 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.444395 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.444481 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.444706 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.444795 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.445033 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.445119 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.445320 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.445417 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.445629 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.445722 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.446007 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.446235 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.446416 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.446566 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.446729 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.447000 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.447086 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.447318 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.447404 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.447635 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.447720 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.447967 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.448070 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.448284 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.448370 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.448591 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.448677 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.448904 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.448991 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.449214 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.449313 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.449515 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.449610 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.449826 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.449921 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.450133 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.450227 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.450458 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.450703 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.450793 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.451038 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.451126 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.451357 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.451460 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.451665 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.451759 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.451998 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.452088 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.452313 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.452425 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.452635 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.452722 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.452943 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.453029 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.453254 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.453349 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.453564 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.453648 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.453866 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.453952 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.454169 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.454263 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.454476 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.454562 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.454787 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.455043 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.455489 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.455720 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.455824 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.456041 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.456128 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.456354 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.456456 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.456768 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.456877 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.457078 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.457225 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.457382 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.457462 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.457686 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.457764 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.458001 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.458077 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.458306 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.458392 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.458613 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.458699 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.458915 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.458997 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.459216 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.459292 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.459527 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.459604 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.459828 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.459963 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.460157 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.460244 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.460461 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.460575 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.460771 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.460849 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.461079 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.461165 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.461385 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.461495 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.461778 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.462010 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.462122 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.462326 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.462430 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.462647 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.462725 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.462954 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.463039 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.463267 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.463344 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.463576 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.463650 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.463912 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.464005 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.464232 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.464308 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.464538 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.464635 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.464837 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.464923 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.465141 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.465214 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.465451 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.465523 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.465761 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.465846 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.466070 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.466145 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.466375 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.466450 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.466740 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.466838 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.467366 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.467465 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.467546 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.467623 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.467623 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.467755 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.467943 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.468034 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.468249 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.468341 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.468552 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.468631 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.468858 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.468958 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.469160 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.469253 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.469460 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.469546 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.469761 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.469854 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.470068 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.470159 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.470368 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.470454 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.470671 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.470765 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.470973 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.471079 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.471301 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.471429 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.471591 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.471681 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.471909 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.472016 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.472281 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.472367 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.472586 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.472672 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.472889 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.472985 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.473197 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.473281 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.473503 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.473588 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.473803 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.473901 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.474109 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.474195 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.474412 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.474507 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.474730 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.474817 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.475033 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.475119 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.475336 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.475427 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.475641 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.475727 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.475966 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.476054 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.476273 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.476360 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.476572 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.476658 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.476880 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.476975 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.477246 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.477380 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.477567 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.477805 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.477970 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.478155 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.478279 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.478460 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.478622 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.478780 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.478939 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.479088 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.479253 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.479392 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.479568 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.479700 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.479904 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.480027 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.480242 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.480353 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.480551 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.480646 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.480862 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.481006 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.481168 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.481311 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.481474 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.481618 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.481780 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.481932 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.482090 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.482243 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.482394 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.482554 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.482697 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.482875 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.482999 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.483180 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.483305 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.483497 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.483593 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.483807 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.483923 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.484146 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.484235 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.484451 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.484538 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.484756 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.484857 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.485076 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.485162 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.485387 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.485474 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.485697 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.485785 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.486017 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.486104 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.486338 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.486423 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.486657 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.486752 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.486965 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.487108 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.487272 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.487372 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.487580 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.487675 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.487903 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.487997 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.488210 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.488296 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.488517 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.488602 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.488826 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.488910 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.489136 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.489227 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.489436 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.489529 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.489740 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.489824 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.490045 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.490137 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.490350 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.490437 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.490656 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.490739 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.490977 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.491077 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.491299 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.491386 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.491625 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.491786 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.491938 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.492041 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.492247 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.492335 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.492557 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.492687 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.493025 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.493123 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.493400 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.493596 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.493695 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.493870 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.494109 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.494197 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.494422 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.494508 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.494734 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.494821 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.495041 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.495130 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.495351 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.495437 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.495662 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.495748 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.496008 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.496112 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.496320 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.496406 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.496622 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.496707 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.496947 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.497047 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.497259 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.497358 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.497563 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.497659 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.497873 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.497960 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.498182 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.498269 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.498494 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.498590 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.498801 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.498887 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.499188 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.499310 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.499498 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.499623 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.499803 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.499959 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.500132 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.500267 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.500454 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.500584 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.500760 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.500897 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.501079 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.501215 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.501491 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.501569 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.501800 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.501875 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.502103 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.502341 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.502517 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.502657 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.502835 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.502972 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.503147 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.503287 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.503471 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.503593 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.503821 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.503931 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.504218 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.504318 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.504525 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.504602 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.504834 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.504908 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.505209 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.505534 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.505771 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.505986 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.506059 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.506147 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.506227 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.506295 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.506366 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.506766 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.507015 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.507445 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.507537 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.507614 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.507682 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.507775 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.507845 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.508070 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.508159 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.508456 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.508658 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.509051 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.509359 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.509571 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.509853 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.509952 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.510033 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.510128 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.510335 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.510422 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.510665 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.510752 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.510975 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.511064 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.511281 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.511368 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.511593 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.511679 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.511916 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.512008 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.512229 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.512318 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.512555 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.512641 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.512861 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.512958 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.513183 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.513271 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.513495 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.513588 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.513806 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.513909 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.514116 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.514211 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.514420 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.514516 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.514742 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.514829 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.515049 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.515143 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.515370 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.515467 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.515685 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.515771 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.516032 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.516122 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.516341 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.516440 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.516648 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.516732 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.516968 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.517053 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.517274 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.517371 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.517582 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.517679 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.517885 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.517998 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.518192 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.518311 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.518535 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.518627 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.518843 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.518930 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.519166 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.519255 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.519499 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.519586 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.519817 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.519923 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.520154 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.520242 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.520476 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.520561 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.520796 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.520884 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.521102 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.521190 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.521423 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.521511 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.521733 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.521829 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.522036 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.522128 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.522340 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.522426 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.522639 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.522733 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.522946 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.523039 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.523257 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.523352 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.523560 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.523656 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.523873 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.524026 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.524345 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.524458 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.524692 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.524883 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.525001 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.525226 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.525321 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.525557 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.525721 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.525880 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.525980 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.526203 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.526291 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.526516 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.526611 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.526829 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.526916 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.527132 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.527226 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.527443 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.527544 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.527750 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.527847 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.528076 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.528164 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.528381 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.528470 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.528691 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.528788 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.528995 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.529082 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.529297 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.529385 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.529602 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.529689 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.529913 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.530012 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.530216 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.530303 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.530530 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.530622 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.530838 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.530924 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.531140 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.531226 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.531439 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.531525 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.531744 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.531831 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.532082 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.532171 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.532396 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.532641 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.532729 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.532974 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.533065 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.533295 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.533433 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.533611 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.533755 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.533926 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.534070 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.534332 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.534434 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.534551 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.534689 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.534864 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.535004 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.535177 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.535320 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.535490 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.535635 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.535803 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.535964 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.536157 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.536280 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.536483 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.536587 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.536807 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.536893 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.537149 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.537448 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.537534 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.537775 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.537893 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.538089 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.538188 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.538404 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.538508 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.538722 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.538825 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.539039 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.539133 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.539350 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.539451 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.539710 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.539809 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.540064 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.540317 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.540403 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.540678 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.540764 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.540991 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.541085 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.541304 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.541404 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.541618 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.541705 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.541927 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.542012 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.542235 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.542333 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.542550 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.542636 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.542864 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.542958 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.543196 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.543295 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.543511 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.543601 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.543833 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.543936 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.544170 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.544269 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.544484 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.544580 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.544795 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.544881 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.545109 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.545314 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.545408 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.545630 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.545723 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.545964 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.546050 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.546287 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.546371 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.546611 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.546694 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.546922 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.547017 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.547232 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.547317 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.547543 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.547628 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.547849 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.547951 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.548180 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.548274 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.548489 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.548575 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.548799 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.548886 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.549104 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.549188 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.549430 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.549523 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.549738 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.549823 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.550042 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.550258 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.550364 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.550578 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.550664 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.550916 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.551192 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.551284 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.551548 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.551641 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.551863 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.551966 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.552204 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.552300 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.552530 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.552623 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.552834 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.552918 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.553141 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.553235 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.553452 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.553539 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.553761 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.553845 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.554067 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.554152 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.554384 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.554482 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.554696 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.554801 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.554998 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.555081 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.555350 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.555521 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.555815 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.555928 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.556178 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.556439 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.556533 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.556789 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.556961 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.557094 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.557177 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.557418 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.557503 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.557725 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.557808 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.558032 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.558115 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.558340 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.558424 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.558648 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.558730 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.558957 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.559050 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.559262 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.559354 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.559564 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.559657 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.559866 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.560014 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.560197 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.560289 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.560497 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.560580 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.560806 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.560903 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.561110 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.561196 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.561412 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.561495 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.561713 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.561805 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.562015 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.562099 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.562343 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.562427 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.562649 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.562813 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.562951 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.563035 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.563251 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.563335 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.563563 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.563649 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.563866 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.564010 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.564210 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.564296 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.564521 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.564628 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.564834 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.564930 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.565177 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.565262 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.565495 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.565582 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.565816 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.566029 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.566117 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.566362 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.566456 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.566682 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.566767 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.567013 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.567099 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.567342 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.567430 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.567649 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.567732 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.567974 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.568076 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.568278 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.568373 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.568589 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.568673 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.568899 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.568989 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.569209 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.569296 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.569515 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.569605 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.569820 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.569903 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.570129 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.570215 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.570438 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.570532 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.570745 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.571058 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.571166 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.571444 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.571588 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.571753 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.571935 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.572094 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.572275 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.572405 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.572612 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.572697 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.572924 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.573017 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.573232 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.573317 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.573539 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.573623 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.573864 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.573950 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.574183 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.574267 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.574496 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.574580 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.574810 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.574951 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.575120 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.575204 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.575428 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.575512 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.575736 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.575821 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.576068 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.576155 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.576376 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.576459 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.576687 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.576774 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.576997 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.577093 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.577299 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.577391 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.577604 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.577713 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.577913 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.578025 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.578222 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.578344 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.578535 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.578668 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.578879 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.578964 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.579201 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.579294 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.579517 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.579601 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.579832 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.579934 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.580622 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.580731 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.580870 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.580957 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.581199 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.581284 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.581514 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.581608 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.581823 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.581918 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.582139 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.582224 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.582442 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.582535 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.582744 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.582829 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.583049 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.583147 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.583361 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.583467 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.583678 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.583785 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.584015 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.584139 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.584318 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.584464 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.584621 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.584774 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.584957 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.585100 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.585227 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.585402 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.585527 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.585713 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.585828 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.586036 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.586163 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.586346 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.586486 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.586780 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.586880 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.587084 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.587255 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.587387 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.587586 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.587692 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.587932 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.588021 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.588244 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.588342 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.588552 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.588644 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.588857 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.588950 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.589169 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.589261 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.589465 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.589559 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.589768 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.589853 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.590069 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.590153 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.590371 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.590463 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.590678 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.590763 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.590981 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.591065 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.591285 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.591383 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.591589 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.591675 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.591931 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.592020 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.592223 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.592388 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.592575 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.592668 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.592829 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.592921 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.593131 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.593239 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.593430 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.593548 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.593732 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.593882 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.594037 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.594195 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.594346 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.594505 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.594649 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.594815 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.594952 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.595131 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.595253 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.595442 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.595563 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.595750 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.595983 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.596106 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.596321 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.596433 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.596658 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.596760 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.596975 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.597060 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.597296 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.597381 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.597608 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.597702 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.597928 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.598013 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.598236 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.598333 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.598558 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.598659 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.598862 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.598946 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.599171 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.599256 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.599477 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.599562 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.599784 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.599868 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.600130 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.600224 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.600440 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.600526 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.600749 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.600835 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.601063 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.601247 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.601373 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.601573 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.601679 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.601891 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.602005 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.602246 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.602534 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.602619 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.602955 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.603048 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.603286 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.603377 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.603604 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.603691 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.603947 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.604037 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.604270 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.604367 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.604582 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.604667 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.604910 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.604994 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.605219 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.605312 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.605540 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.605632 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.605833 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.605917 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.606078 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 16:27:48.606165 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.606584 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.606743 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.607049 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.607358 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.607672 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.608013 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.608341 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.608667 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.608977 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.609299 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.609624 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.609973 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.610286 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.610626 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.610954 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.611321 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.611683 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.612012 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:27:48.612259 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 16:27:48.762407 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO dbcounter [None req-6f95428b-abdc-412e-8e9c-d52dc829b3f9 None None] Registered counter for database nova_api Sep 01 16:27:48.770653 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: INFO dbcounter [None req-9f9e7ca3-2d2a-40dd-af5b-b3a3e5c1abf4 None None] Registered counter for database nova_api Sep 01 16:27:48.783985 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG oslo_db.sqlalchemy.engines [None req-6f95428b-abdc-412e-8e9c-d52dc829b3f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105740) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:27:48.791824 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG dbcounter [-] [105740] Writer thread running {{(pid=105740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:27:48.792103 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG oslo_db.sqlalchemy.engines [None req-9f9e7ca3-2d2a-40dd-af5b-b3a3e5c1abf4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105741) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:27:48.799641 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG dbcounter [-] [105741] Writer thread running {{(pid=105741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:27:48.849222 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.context [None req-6f95428b-abdc-412e-8e9c-d52dc829b3f9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a5e68055-5bd9-4290-838f-85cccc8a7442(cell1) {{(pid=105740) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 16:27:48.853373 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG oslo_concurrency.lockutils [None req-6f95428b-abdc-412e-8e9c-d52dc829b3f9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:27:48.853846 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG oslo_concurrency.lockutils [None req-6f95428b-abdc-412e-8e9c-d52dc829b3f9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:27:48.855398 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG oslo_concurrency.lockutils [None req-6f95428b-abdc-412e-8e9c-d52dc829b3f9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:27:48.856159 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG oslo_concurrency.lockutils [None req-6f95428b-abdc-412e-8e9c-d52dc829b3f9 None None] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:27:48.856602 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG oslo_concurrency.lockutils [None req-6f95428b-abdc-412e-8e9c-d52dc829b3f9 None None] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:27:48.857504 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.context [None req-9f9e7ca3-2d2a-40dd-af5b-b3a3e5c1abf4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a5e68055-5bd9-4290-838f-85cccc8a7442(cell1) {{(pid=105741) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 16:27:48.858593 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG oslo_concurrency.lockutils [None req-6f95428b-abdc-412e-8e9c-d52dc829b3f9 None None] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:27:48.860625 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO dbcounter [None req-6f95428b-abdc-412e-8e9c-d52dc829b3f9 None None] Registered counter for database nova_cell0 Sep 01 16:27:48.861418 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG oslo_concurrency.lockutils [None req-9f9e7ca3-2d2a-40dd-af5b-b3a3e5c1abf4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:27:48.861898 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG oslo_concurrency.lockutils [None req-9f9e7ca3-2d2a-40dd-af5b-b3a3e5c1abf4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:27:48.863580 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG oslo_concurrency.lockutils [None req-9f9e7ca3-2d2a-40dd-af5b-b3a3e5c1abf4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:27:48.864326 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG oslo_concurrency.lockutils [None req-9f9e7ca3-2d2a-40dd-af5b-b3a3e5c1abf4 None None] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:27:48.864637 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO dbcounter [None req-6f95428b-abdc-412e-8e9c-d52dc829b3f9 None None] Registered counter for database nova_cell1 Sep 01 16:27:48.864770 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG oslo_concurrency.lockutils [None req-9f9e7ca3-2d2a-40dd-af5b-b3a3e5c1abf4 None None] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:27:48.866818 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG oslo_concurrency.lockutils [None req-9f9e7ca3-2d2a-40dd-af5b-b3a3e5c1abf4 None None] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:27:48.869263 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: INFO dbcounter [None req-9f9e7ca3-2d2a-40dd-af5b-b3a3e5c1abf4 None None] Registered counter for database nova_cell0 Sep 01 16:27:48.872881 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG oslo_db.sqlalchemy.engines [None req-6f95428b-abdc-412e-8e9c-d52dc829b3f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105740) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:27:48.873568 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: INFO dbcounter [None req-9f9e7ca3-2d2a-40dd-af5b-b3a3e5c1abf4 None None] Registered counter for database nova_cell1 Sep 01 16:27:48.874596 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG oslo_db.sqlalchemy.engines [None req-6f95428b-abdc-412e-8e9c-d52dc829b3f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105740) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:27:48.880685 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG oslo_db.sqlalchemy.engines [None req-9f9e7ca3-2d2a-40dd-af5b-b3a3e5c1abf4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105741) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:27:48.881011 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG dbcounter [-] [105740] Writer thread running {{(pid=105740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:27:48.882078 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG oslo_db.sqlalchemy.engines [None req-9f9e7ca3-2d2a-40dd-af5b-b3a3e5c1abf4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105741) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:27:48.882523 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG dbcounter [-] [105740] Writer thread running {{(pid=105740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:27:48.888028 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG dbcounter [-] [105741] Writer thread running {{(pid=105741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:27:48.890659 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG dbcounter [-] [105741] Writer thread running {{(pid=105741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:27:49.026087 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO dbcounter [None req-6f95428b-abdc-412e-8e9c-d52dc829b3f9 None None] Registered counter for database nova_cell0 Sep 01 16:27:49.032538 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: INFO dbcounter [None req-9f9e7ca3-2d2a-40dd-af5b-b3a3e5c1abf4 None None] Registered counter for database nova_cell0 Sep 01 16:27:49.035432 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG oslo_db.sqlalchemy.engines [None req-6f95428b-abdc-412e-8e9c-d52dc829b3f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105740) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:27:49.041935 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG dbcounter [-] [105740] Writer thread running {{(pid=105740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:27:49.042659 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG oslo_db.sqlalchemy.engines [None req-9f9e7ca3-2d2a-40dd-af5b-b3a3e5c1abf4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105741) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:27:49.047614 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG dbcounter [-] [105741] Writer thread running {{(pid=105741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:27:49.377264 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: WARNING keystonemiddleware.auth_token [None req-6f95428b-abdc-412e-8e9c-d52dc829b3f9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 16:27:49.378927 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: WARNING keystonemiddleware.auth_token [None req-9f9e7ca3-2d2a-40dd-af5b-b3a3e5c1abf4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 16:27:49.384594 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: WARNING keystonemiddleware.auth_token [None req-6f95428b-abdc-412e-8e9c-d52dc829b3f9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 16:27:49.386371 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: WARNING keystonemiddleware.auth_token [None req-9f9e7ca3-2d2a-40dd-af5b-b3a3e5c1abf4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 16:27:49.725331 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: WARNING keystonemiddleware.auth_token [None req-6f95428b-abdc-412e-8e9c-d52dc829b3f9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 16:27:49.729225 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: WARNING keystonemiddleware.auth_token [None req-9f9e7ca3-2d2a-40dd-af5b-b3a3e5c1abf4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 16:27:49.731337 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: WARNING keystonemiddleware.auth_token [None req-6f95428b-abdc-412e-8e9c-d52dc829b3f9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 16:27:49.735213 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: WARNING keystonemiddleware.auth_token [None req-9f9e7ca3-2d2a-40dd-af5b-b3a3e5c1abf4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 16:27:49.736601 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b9928ad9c0 pid: 105740 (default app) Sep 01 16:27:49.738657 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-6f95428b-abdc-412e-8e9c-d52dc829b3f9 None None] Calling method '>' {{(pid=105740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:27:49.739913 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO nova.api.openstack.requestlog [None req-6f95428b-abdc-412e-8e9c-d52dc829b3f9 None None] 10.222.0.62 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001740 Sep 01 16:27:49.740325 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: [pid: 105740|app: 0|req: 1/1] 10.222.0.62 () {50 vars in 788 bytes} [Thu Sep 1 16:27:49 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:27:49.740462 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b9928ad9c0 pid: 105741 (default app) Sep 01 16:29:09.132550 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-6f95428b-abdc-412e-8e9c-d52dc829b3f9 None None] Calling method '>' {{(pid=105740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:29:09.133814 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO nova.api.openstack.requestlog [None req-6f95428b-abdc-412e-8e9c-d52dc829b3f9 None None] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001713 Sep 01 16:29:09.134387 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: [pid: 105740|app: 0|req: 2/2] 10.222.0.62 () {54 vars in 931 bytes} [Thu Sep 1 16:29:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:29:09.150960 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG dbcounter [-] [105741] Writing DB stats nova_api:SELECT=3 {{(pid=105741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:09.153140 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG dbcounter [-] [105741] Writing DB stats nova_cell0:SELECT=3 {{(pid=105741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:09.153987 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG dbcounter [-] [105741] Writing DB stats nova_cell1:SELECT=3 {{(pid=105741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:09.155123 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG dbcounter [-] [105741] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:10.029230 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi [None req-1d200a82-1a89-42d7-b558-d50dcc949f23 admin admin] Calling method '>' {{(pid=105741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:29:10.061520 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: INFO nova.api.openstack.requestlog [None req-1d200a82-1a89-42d7-b558-d50dcc949f23 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.919980 Sep 01 16:29:10.062284 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: [pid: 105741|app: 0|req: 1/3] 10.222.0.62 () {60 vars in 1292 bytes} [Thu Sep 1 16:29:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:29:12.399125 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-6f95428b-abdc-412e-8e9c-d52dc829b3f9 None None] Calling method '>' {{(pid=105740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:29:12.400185 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO nova.api.openstack.requestlog [None req-6f95428b-abdc-412e-8e9c-d52dc829b3f9 None None] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Sep 01 16:29:12.400772 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: [pid: 105740|app: 0|req: 3/4] 10.222.0.62 () {54 vars in 931 bytes} [Thu Sep 1 16:29:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:29:12.856596 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi [None req-ad03d069-8c88-4495-b374-2d03898bf891 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "os-flavor-access:is_public": true, "ram": 256, "id": "c1", "name": "cirros256", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0}} {{(pid=105741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:29:12.908692 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: INFO nova.api.openstack.requestlog [None req-ad03d069-8c88-4495-b374-2d03898bf891 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.501707 Sep 01 16:29:12.909366 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: [pid: 105741|app: 0|req: 2/5] 10.222.0.62 () {64 vars in 1283 bytes} [Thu Sep 1 16:29:12 2022] POST /compute/v2.1/flavors => generated 407 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 16:29:12.922859 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG dbcounter [-] [105740] Writing DB stats nova_api:SELECT=3 {{(pid=105740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:12.923681 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG dbcounter [-] [105740] Writing DB stats nova_cell0:SELECT=3 {{(pid=105740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:12.924714 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG dbcounter [-] [105740] Writing DB stats nova_cell1:SELECT=3 {{(pid=105740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:12.925980 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG dbcounter [-] [105740] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:13.137286 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-e11f0eff-f066-4fb0-a9a0-42c0f8560bda admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:29:13.204835 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO nova.api.openstack.requestlog [None req-e11f0eff-f066-4fb0-a9a0-42c0f8560bda admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.287128 Sep 01 16:29:13.212308 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: [pid: 105740|app: 0|req: 4/6] 10.222.0.62 () {64 vars in 1336 bytes} [Thu Sep 1 16:29:12 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:29:15.604068 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi [None req-ad03d069-8c88-4495-b374-2d03898bf891 admin admin] Calling method '>' {{(pid=105741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:29:15.605195 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: INFO nova.api.openstack.requestlog [None req-ad03d069-8c88-4495-b374-2d03898bf891 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001692 Sep 01 16:29:15.605911 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: [pid: 105741|app: 0|req: 3/7] 10.222.0.62 () {54 vars in 931 bytes} [Thu Sep 1 16:29:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:29:16.296642 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-d6b358be-97a8-4772-b747-4653f9daa397 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "ram": 512, "disk": 5, "id": "d1", "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=105740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:29:16.346275 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO nova.api.openstack.requestlog [None req-d6b358be-97a8-4772-b747-4653f9daa397 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.733720 Sep 01 16:29:16.347775 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: [pid: 105740|app: 0|req: 5/8] 10.222.0.62 () {64 vars in 1283 bytes} [Thu Sep 1 16:29:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:29:16.361102 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi [None req-b2245d05-45ff-417c-9831-c6a2cf43e96c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:29:16.401587 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: INFO nova.api.openstack.requestlog [None req-b2245d05-45ff-417c-9831-c6a2cf43e96c admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045216 Sep 01 16:29:16.402176 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: [pid: 105741|app: 0|req: 4/9] 10.222.0.62 () {64 vars in 1336 bytes} [Thu Sep 1 16:29:16 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:29:18.772599 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-d6b358be-97a8-4772-b747-4653f9daa397 admin admin] Calling method '>' {{(pid=105740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:29:18.773617 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO nova.api.openstack.requestlog [None req-d6b358be-97a8-4772-b747-4653f9daa397 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Sep 01 16:29:18.774016 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: [pid: 105740|app: 0|req: 6/10] 10.222.0.62 () {54 vars in 931 bytes} [Thu Sep 1 16:29:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:29:19.173105 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi [None req-fad47f45-ca8e-4a5e-b8a6-df9cc6a39714 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "ram": 1024, "id": "d2", "rxtx_factor": 1.0, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "os-flavor-access:is_public": true}} {{(pid=105741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:29:19.193442 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: INFO nova.api.openstack.requestlog [None req-fad47f45-ca8e-4a5e-b8a6-df9cc6a39714 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.413090 Sep 01 16:29:19.194106 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: [pid: 105741|app: 0|req: 5/11] 10.222.0.62 () {64 vars in 1283 bytes} [Thu Sep 1 16:29:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:29:19.206817 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-41b83b4e-0692-4cb7-9333-de538091fbb6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:29:19.231571 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO nova.api.openstack.requestlog [None req-41b83b4e-0692-4cb7-9333-de538091fbb6 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028871 Sep 01 16:29:19.232172 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: [pid: 105740|app: 0|req: 7/12] 10.222.0.62 () {64 vars in 1336 bytes} [Thu Sep 1 16:29:19 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:29:21.590108 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi [None req-fad47f45-ca8e-4a5e-b8a6-df9cc6a39714 admin admin] Calling method '>' {{(pid=105741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:29:21.591143 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: INFO nova.api.openstack.requestlog [None req-fad47f45-ca8e-4a5e-b8a6-df9cc6a39714 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Sep 01 16:29:21.591518 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: [pid: 105741|app: 0|req: 6/13] 10.222.0.62 () {54 vars in 931 bytes} [Thu Sep 1 16:29:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:29:22.081293 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-d17ae18a-2af9-4806-93c7-a24979eb2c99 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 2, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 10, "id": "d3", "ram": 2048}} {{(pid=105740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:29:22.104269 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO nova.api.openstack.requestlog [None req-d17ae18a-2af9-4806-93c7-a24979eb2c99 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.506065 Sep 01 16:29:22.105224 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: [pid: 105740|app: 0|req: 8/14] 10.222.0.62 () {64 vars in 1283 bytes} [Thu Sep 1 16:29:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 16:29:22.117723 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi [None req-e6bfec23-f99b-485c-bf17-4720d51e3561 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:29:22.143002 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: INFO nova.api.openstack.requestlog [None req-e6bfec23-f99b-485c-bf17-4720d51e3561 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029367 Sep 01 16:29:22.143577 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: [pid: 105741|app: 0|req: 7/15] 10.222.0.62 () {64 vars in 1336 bytes} [Thu Sep 1 16:29:22 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:29:24.513618 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-d17ae18a-2af9-4806-93c7-a24979eb2c99 admin admin] Calling method '>' {{(pid=105740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:29:24.514648 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO nova.api.openstack.requestlog [None req-d17ae18a-2af9-4806-93c7-a24979eb2c99 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Sep 01 16:29:24.516479 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: [pid: 105740|app: 0|req: 9/16] 10.222.0.62 () {54 vars in 931 bytes} [Thu Sep 1 16:29:24 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:29:24.964675 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi [None req-4f7d9d0e-dc4a-467c-9795-8ad2cbb93a3b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "vcpus": 4, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "name": "ds4G", "ram": 4096}} {{(pid=105741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:29:24.985134 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: INFO nova.api.openstack.requestlog [None req-4f7d9d0e-dc4a-467c-9795-8ad2cbb93a3b admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.462855 Sep 01 16:29:24.985959 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: [pid: 105741|app: 0|req: 8/17] 10.222.0.62 () {64 vars in 1283 bytes} [Thu Sep 1 16:29:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 16:29:24.998362 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-3621ddbe-075e-4dd6-ab43-48d22679d1b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:29:25.027414 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO nova.api.openstack.requestlog [None req-3621ddbe-075e-4dd6-ab43-48d22679d1b5 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032843 Sep 01 16:29:25.032416 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: [pid: 105740|app: 0|req: 10/18] 10.222.0.62 () {64 vars in 1336 bytes} [Thu Sep 1 16:29:24 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:29:27.501968 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi [None req-4f7d9d0e-dc4a-467c-9795-8ad2cbb93a3b admin admin] Calling method '>' {{(pid=105741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:29:27.503001 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: INFO nova.api.openstack.requestlog [None req-4f7d9d0e-dc4a-467c-9795-8ad2cbb93a3b admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Sep 01 16:29:27.503434 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: [pid: 105741|app: 0|req: 9/19] 10.222.0.62 () {54 vars in 931 bytes} [Thu Sep 1 16:29:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:29:27.930991 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-d0689eb5-3d12-406d-a01f-cbb944cf2942 admin admin] Calling method '>' {{(pid=105740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:29:27.956323 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO nova.api.openstack.requestlog [None req-d0689eb5-3d12-406d-a01f-cbb944cf2942 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.446322 Sep 01 16:29:27.956865 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: [pid: 105740|app: 0|req: 11/20] 10.222.0.62 () {60 vars in 1292 bytes} [Thu Sep 1 16:29:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:29:30.675997 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi [None req-4f7d9d0e-dc4a-467c-9795-8ad2cbb93a3b admin admin] Calling method '>' {{(pid=105741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:29:30.677239 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: INFO nova.api.openstack.requestlog [None req-4f7d9d0e-dc4a-467c-9795-8ad2cbb93a3b admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001577 Sep 01 16:29:30.677823 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: [pid: 105741|app: 0|req: 10/21] 10.222.0.62 () {54 vars in 931 bytes} [Thu Sep 1 16:29:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:29:31.101782 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-8d6d739b-e9bd-4d54-aa8f-9e2273a148c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "swap": 0, "os-flavor-access:is_public": true, "ram": 512, "vcpus": 1, "rxtx_factor": 1.0, "name": "m1.tiny"}} {{(pid=105740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:29:31.122722 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO nova.api.openstack.requestlog [None req-8d6d739b-e9bd-4d54-aa8f-9e2273a148c4 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.437138 Sep 01 16:29:31.123211 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: [pid: 105740|app: 0|req: 12/22] 10.222.0.62 () {64 vars in 1283 bytes} [Thu Sep 1 16:29:30 2022] POST /compute/v2.1/flavors => generated 402 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:29:31.138189 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi [None req-de346b48-5d08-4646-adf3-84cc8f1cb8fd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:29:31.167459 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: INFO nova.api.openstack.requestlog [None req-de346b48-5d08-4646-adf3-84cc8f1cb8fd admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032831 Sep 01 16:29:31.168236 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: [pid: 105741|app: 0|req: 11/23] 10.222.0.62 () {64 vars in 1333 bytes} [Thu Sep 1 16:29:31 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:29:33.582407 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-8d6d739b-e9bd-4d54-aa8f-9e2273a148c4 admin admin] Calling method '>' {{(pid=105740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:29:33.583690 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO nova.api.openstack.requestlog [None req-8d6d739b-e9bd-4d54-aa8f-9e2273a148c4 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001728 Sep 01 16:29:33.584096 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: [pid: 105740|app: 0|req: 13/24] 10.222.0.62 () {54 vars in 931 bytes} [Thu Sep 1 16:29:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:29:34.006416 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi [None req-84a1b333-f06a-433e-ad9e-39bed86a04e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "m1.small", "id": "2", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "disk": 20}} {{(pid=105741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:29:34.027065 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: INFO nova.api.openstack.requestlog [None req-84a1b333-f06a-433e-ad9e-39bed86a04e2 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.436396 Sep 01 16:29:34.027547 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: [pid: 105741|app: 0|req: 12/25] 10.222.0.62 () {64 vars in 1283 bytes} [Thu Sep 1 16:29:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:29:34.040192 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-12031a02-2882-4c78-9a33-ff447fa501be admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:29:34.065448 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO nova.api.openstack.requestlog [None req-12031a02-2882-4c78-9a33-ff447fa501be admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029496 Sep 01 16:29:34.066014 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: [pid: 105740|app: 0|req: 14/26] 10.222.0.62 () {64 vars in 1333 bytes} [Thu Sep 1 16:29:34 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:29:36.439770 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi [None req-84a1b333-f06a-433e-ad9e-39bed86a04e2 admin admin] Calling method '>' {{(pid=105741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:29:36.440775 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: INFO nova.api.openstack.requestlog [None req-84a1b333-f06a-433e-ad9e-39bed86a04e2 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001557 Sep 01 16:29:36.458796 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: [pid: 105741|app: 0|req: 13/27] 10.222.0.62 () {54 vars in 931 bytes} [Thu Sep 1 16:29:36 2022] GET /compute/v2.1 => generated 388 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:29:36.923879 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-1832ec0d-433f-4658-b34e-f28b026298ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "rxtx_factor": 1.0, "name": "m1.medium", "disk": 40, "id": "3", "os-flavor-access:is_public": true}} {{(pid=105740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:29:36.944478 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO nova.api.openstack.requestlog [None req-1832ec0d-433f-4658-b34e-f28b026298ff admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.496355 Sep 01 16:29:36.945045 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: [pid: 105740|app: 0|req: 15/28] 10.222.0.62 () {64 vars in 1283 bytes} [Thu Sep 1 16:29:36 2022] POST /compute/v2.1/flavors => generated 406 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:29:36.957362 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi [None req-66d86a5b-c55f-4e89-97fd-a3e9c4586e25 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:29:36.983365 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: INFO nova.api.openstack.requestlog [None req-66d86a5b-c55f-4e89-97fd-a3e9c4586e25 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029627 Sep 01 16:29:36.987947 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: [pid: 105741|app: 0|req: 14/29] 10.222.0.62 () {64 vars in 1333 bytes} [Thu Sep 1 16:29:36 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:29:39.326366 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-1832ec0d-433f-4658-b34e-f28b026298ff admin admin] Calling method '>' {{(pid=105740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:29:39.327836 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO nova.api.openstack.requestlog [None req-1832ec0d-433f-4658-b34e-f28b026298ff admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004194 Sep 01 16:29:39.328343 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: [pid: 105740|app: 0|req: 16/30] 10.222.0.62 () {54 vars in 931 bytes} [Thu Sep 1 16:29:39 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:29:39.856749 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi [None req-2f86408a-1098-41be-b1c8-8c0ef534662e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.large", "ram": 8192, "id": "4"}} {{(pid=105741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:29:39.862615 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG dbcounter [-] [105741] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:39.879310 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: INFO nova.api.openstack.requestlog [None req-2f86408a-1098-41be-b1c8-8c0ef534662e admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.544140 Sep 01 16:29:39.880199 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: [pid: 105741|app: 0|req: 15/31] 10.222.0.62 () {64 vars in 1283 bytes} [Thu Sep 1 16:29:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:29:39.895339 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-c378acf4-23d1-446d-a5c1-240383122b9d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:29:39.922371 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO nova.api.openstack.requestlog [None req-c378acf4-23d1-446d-a5c1-240383122b9d admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030927 Sep 01 16:29:39.923075 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: [pid: 105740|app: 0|req: 17/32] 10.222.0.62 () {64 vars in 1333 bytes} [Thu Sep 1 16:29:39 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:29:42.374435 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi [None req-2f86408a-1098-41be-b1c8-8c0ef534662e admin admin] Calling method '>' {{(pid=105741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:29:42.375420 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: INFO nova.api.openstack.requestlog [None req-2f86408a-1098-41be-b1c8-8c0ef534662e admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Sep 01 16:29:42.381547 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: [pid: 105741|app: 0|req: 16/33] 10.222.0.62 () {54 vars in 931 bytes} [Thu Sep 1 16:29:42 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:29:42.807035 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-82436ff3-6c68-4b66-8095-df48d5a1af4d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.xlarge", "id": "5", "disk": 160, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=105740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:29:42.828294 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO nova.api.openstack.requestlog [None req-82436ff3-6c68-4b66-8095-df48d5a1af4d admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.445414 Sep 01 16:29:42.829108 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: [pid: 105740|app: 0|req: 18/34] 10.222.0.62 () {64 vars in 1283 bytes} [Thu Sep 1 16:29:42 2022] POST /compute/v2.1/flavors => generated 408 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:29:42.841507 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi [None req-3d405c25-fb5d-4158-a755-88325f3fece4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:29:42.868908 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: INFO nova.api.openstack.requestlog [None req-3d405c25-fb5d-4158-a755-88325f3fece4 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031005 Sep 01 16:29:42.869923 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: [pid: 105741|app: 0|req: 17/35] 10.222.0.62 () {64 vars in 1333 bytes} [Thu Sep 1 16:29:42 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:30:01.578393 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-82436ff3-6c68-4b66-8095-df48d5a1af4d admin admin] Calling method '>' {{(pid=105740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:30:01.579719 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO nova.api.openstack.requestlog [None req-82436ff3-6c68-4b66-8095-df48d5a1af4d admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002401 Sep 01 16:30:01.580266 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: [pid: 105740|app: 0|req: 19/36] 10.222.0.62 () {54 vars in 931 bytes} [Thu Sep 1 16:30:01 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:30:01.592675 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG dbcounter [-] [105741] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:02.024317 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi [None req-3a53280d-9e01-4888-8ffd-aab18c467027 admin admin] Calling method '>' {{(pid=105741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:30:02.044380 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: INFO nova.api.openstack.requestlog [None req-3a53280d-9e01-4888-8ffd-aab18c467027 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.456369 Sep 01 16:30:02.044916 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: [pid: 105741|app: 0|req: 18/37] 10.222.0.62 () {60 vars in 1292 bytes} [Thu Sep 1 16:30:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:30:03.124605 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-82436ff3-6c68-4b66-8095-df48d5a1af4d admin admin] Calling method '>' {{(pid=105740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:30:03.125659 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO nova.api.openstack.requestlog [None req-82436ff3-6c68-4b66-8095-df48d5a1af4d admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Sep 01 16:30:03.126059 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: [pid: 105740|app: 0|req: 20/38] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Sep 1 16:30:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:30:03.692548 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi [None req-f6a40d5a-094b-475c-8b22-d41e521b2054 admin admin] Calling method '>' {{(pid=105741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:30:03.698526 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: INFO nova.api.openstack.wsgi [None req-f6a40d5a-094b-475c-8b22-d41e521b2054 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 01 16:30:03.701795 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi [None req-f6a40d5a-094b-475c-8b22-d41e521b2054 admin admin] Request method failure captured: Sep 01 16:30:03.701795 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 01 16:30:03.701795 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: Accept: application/json Sep 01 16:30:03.701795 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: Accept-Encoding: gzip, deflate Sep 01 16:30:03.701795 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: Connection: keep-alive Sep 01 16:30:03.701795 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: Content-Length: 0 Sep 01 16:30:03.701795 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: Host: 10.222.0.62 Sep 01 16:30:03.701795 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: Openstack-Api-Version: compute 2.90 Sep 01 16:30:03.701795 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: Openstack-System-Scope: None Sep 01 16:30:03.701795 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: User-Agent: python-novaclient Sep 01 16:30:03.701795 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Auth-Token: gAAAAABjEN4LZJf5rSm5CFlwRZrNtVGDJYa6j3GUpaMTWbAnbqTETqp7T70nGbqaAyKbpmY__yCOGf9A1kQO8YQWDveL8e7ov86VHZi0EUeZvTYaWWDaSj2pjJP5_dHVBdT3COyf-BGc1J3AuSq5MPw2Sz-9_ayjaCZAw14C5AwPRxcEFnLdkqc Sep 01 16:30:03.701795 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Domain-Id: None Sep 01 16:30:03.701795 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Domain-Name: None Sep 01 16:30:03.701795 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Identity-Status: Confirmed Sep 01 16:30:03.701795 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Is-Admin-Project: True Sep 01 16:30:03.701795 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 16:30:03.701795 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Project-Domain-Id: default Sep 01 16:30:03.701795 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Project-Domain-Name: Default Sep 01 16:30:03.701795 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Project-Id: 026b4ed9c3cf48a48d86818cba23c13c Sep 01 16:30:03.701795 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Project-Name: admin Sep 01 16:30:03.701795 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Role: admin,reader,member Sep 01 16:30:03.701795 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Roles: admin,reader,member Sep 01 16:30:03.703695 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/026b4ed9c3cf48a48d86818cba23c13c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/026b4ed9c3cf48a48d86818cba23c13c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_026b4ed9c3cf48a48d86818cba23c13c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/026b4ed9c3cf48a48d86818cba23c13c"}]}] Sep 01 16:30:03.703695 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Tenant: admin Sep 01 16:30:03.703695 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Tenant-Id: 026b4ed9c3cf48a48d86818cba23c13c Sep 01 16:30:03.703695 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Tenant-Name: admin Sep 01 16:30:03.703695 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-User: admin Sep 01 16:30:03.703695 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-User-Domain-Id: default Sep 01 16:30:03.703695 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-User-Domain-Name: Default Sep 01 16:30:03.703695 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-User-Id: 82b69c02f3fd4ddc81686f03143f0651 Sep 01 16:30:03.703695 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-User-Name: admin Sep 01 16:30:03.703695 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: method: > Sep 01 16:30:03.703695 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: exception: Flavor 42 could not be found. Sep 01 16:30:03.703695 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: action_args: {'id': '42'} Sep 01 16:30:03.703695 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: {{(pid=105741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:30:03.703695 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:30:03.704773 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 16:30:03.704773 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 16:30:03.704773 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 16:30:03.704773 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 16:30:03.704773 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 16:30:03.704773 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 16:30:03.704773 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 16:30:03.704773 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 16:30:03.704773 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 16:30:03.704773 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:30:03.704773 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 16:30:03.704773 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 16:30:03.704773 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 01 16:30:03.704773 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi Sep 01 16:30:03.704773 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:30:03.704773 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi Sep 01 16:30:03.704773 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:30:03.704773 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:30:03.704773 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:30:03.706191 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:30:03.706191 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:30:03.706191 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:30:03.706191 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:30:03.706191 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 16:30:03.706191 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:30:03.706191 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 01 16:30:03.706191 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi Sep 01 16:30:03.706191 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:30:03.706191 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi Sep 01 16:30:03.706191 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:30:03.706191 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:30:03.706191 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:30:03.706191 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:30:03.706191 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:30:03.706191 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 01 16:30:03.706191 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi Sep 01 16:30:03.706191 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi [None req-f6a40d5a-094b-475c-8b22-d41e521b2054 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:30:03.707449 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: INFO nova.api.openstack.requestlog [None req-f6a40d5a-094b-475c-8b22-d41e521b2054 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.438469 Sep 01 16:30:03.707449 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: [pid: 105741|app: 0|req: 19/39] 10.222.0.62 () {60 vars in 1190 bytes} [Thu Sep 1 16:30:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 440 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 16:30:03.713562 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-ecd15972-d50b-43ad-ade0-73d6845b57b9 admin admin] Calling method '>' {{(pid=105740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:30:03.717843 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG dbcounter [-] [105740] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:03.738700 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO nova.api.openstack.requestlog [None req-ecd15972-d50b-43ad-ade0-73d6845b57b9 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028879 Sep 01 16:30:03.739225 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: [pid: 105740|app: 0|req: 21/40] 10.222.0.62 () {60 vars in 1210 bytes} [Thu Sep 1 16:30:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:30:03.750948 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi [None req-df231b8c-438e-49e2-ade3-4c8a4631025a admin admin] Calling method '>' {{(pid=105741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:30:03.780755 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: INFO nova.api.openstack.requestlog [None req-df231b8c-438e-49e2-ade3-4c8a4631025a admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.034482 Sep 01 16:30:03.781316 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: [pid: 105741|app: 0|req: 20/41] 10.222.0.62 () {60 vars in 1210 bytes} [Thu Sep 1 16:30:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:30:03.791808 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-2b3475e3-3f3c-46e8-a797-41acb669127a admin admin] Calling method '>' {{(pid=105740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:30:03.798174 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO nova.api.openstack.wsgi [None req-2b3475e3-3f3c-46e8-a797-41acb669127a admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 01 16:30:03.801506 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-2b3475e3-3f3c-46e8-a797-41acb669127a admin admin] Request method failure captured: Sep 01 16:30:03.801506 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 01 16:30:03.801506 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: Accept: application/json Sep 01 16:30:03.801506 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: Accept-Encoding: gzip, deflate Sep 01 16:30:03.801506 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: Connection: keep-alive Sep 01 16:30:03.801506 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: Content-Length: 0 Sep 01 16:30:03.801506 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: Host: 10.222.0.62 Sep 01 16:30:03.801506 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: Openstack-Api-Version: compute 2.90 Sep 01 16:30:03.801506 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: Openstack-System-Scope: None Sep 01 16:30:03.801506 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: User-Agent: python-novaclient Sep 01 16:30:03.801506 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Auth-Token: gAAAAABjEN4LZJf5rSm5CFlwRZrNtVGDJYa6j3GUpaMTWbAnbqTETqp7T70nGbqaAyKbpmY__yCOGf9A1kQO8YQWDveL8e7ov86VHZi0EUeZvTYaWWDaSj2pjJP5_dHVBdT3COyf-BGc1J3AuSq5MPw2Sz-9_ayjaCZAw14C5AwPRxcEFnLdkqc Sep 01 16:30:03.801506 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Domain-Id: None Sep 01 16:30:03.801506 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Domain-Name: None Sep 01 16:30:03.801506 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Identity-Status: Confirmed Sep 01 16:30:03.801506 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Is-Admin-Project: True Sep 01 16:30:03.801506 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 16:30:03.801506 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Project-Domain-Id: default Sep 01 16:30:03.801506 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Project-Domain-Name: Default Sep 01 16:30:03.801506 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Project-Id: 026b4ed9c3cf48a48d86818cba23c13c Sep 01 16:30:03.801506 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Project-Name: admin Sep 01 16:30:03.801506 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Role: admin,reader,member Sep 01 16:30:03.801506 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Roles: admin,reader,member Sep 01 16:30:03.803074 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/026b4ed9c3cf48a48d86818cba23c13c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/026b4ed9c3cf48a48d86818cba23c13c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_026b4ed9c3cf48a48d86818cba23c13c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/026b4ed9c3cf48a48d86818cba23c13c"}]}] Sep 01 16:30:03.803074 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Tenant: admin Sep 01 16:30:03.803074 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Tenant-Id: 026b4ed9c3cf48a48d86818cba23c13c Sep 01 16:30:03.803074 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Tenant-Name: admin Sep 01 16:30:03.803074 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-User: admin Sep 01 16:30:03.803074 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-User-Domain-Id: default Sep 01 16:30:03.803074 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-User-Domain-Name: Default Sep 01 16:30:03.803074 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-User-Id: 82b69c02f3fd4ddc81686f03143f0651 Sep 01 16:30:03.803074 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-User-Name: admin Sep 01 16:30:03.803074 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: method: > Sep 01 16:30:03.803074 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: exception: Flavor 42 could not be found. Sep 01 16:30:03.803074 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: action_args: {'id': '42'} Sep 01 16:30:03.803074 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: {{(pid=105740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:30:03.803074 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:30:03.803920 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 16:30:03.803920 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 16:30:03.803920 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 16:30:03.803920 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 16:30:03.803920 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 16:30:03.803920 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 16:30:03.803920 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 16:30:03.803920 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 16:30:03.803920 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 16:30:03.803920 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:30:03.803920 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 16:30:03.803920 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 16:30:03.803920 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 01 16:30:03.803920 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi Sep 01 16:30:03.803920 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:30:03.803920 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi Sep 01 16:30:03.803920 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:30:03.803920 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:30:03.803920 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:30:03.805076 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:30:03.805076 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:30:03.805076 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:30:03.805076 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:30:03.805076 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 16:30:03.805076 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:30:03.805076 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 01 16:30:03.805076 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi Sep 01 16:30:03.805076 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:30:03.805076 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi Sep 01 16:30:03.805076 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:30:03.805076 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:30:03.805076 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:30:03.805076 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:30:03.805076 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:30:03.805076 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 01 16:30:03.805076 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi Sep 01 16:30:03.805076 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-2b3475e3-3f3c-46e8-a797-41acb669127a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:30:03.806367 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO nova.api.openstack.requestlog [None req-2b3475e3-3f3c-46e8-a797-41acb669127a admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015382 Sep 01 16:30:03.806367 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: [pid: 105740|app: 0|req: 22/42] 10.222.0.62 () {60 vars in 1190 bytes} [Thu Sep 1 16:30:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 16:30:04.797074 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi [None req-df231b8c-438e-49e2-ade3-4c8a4631025a admin admin] Calling method '>' {{(pid=105741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:30:04.798096 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: INFO nova.api.openstack.requestlog [None req-df231b8c-438e-49e2-ade3-4c8a4631025a admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Sep 01 16:30:04.798483 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: [pid: 105741|app: 0|req: 21/43] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Sep 1 16:30:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:30:05.376385 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-5c500057-0c2d-4e58-a191-42f5feb9ac17 admin admin] Calling method '>' {{(pid=105740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:30:05.383312 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO nova.api.openstack.wsgi [None req-5c500057-0c2d-4e58-a191-42f5feb9ac17 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 01 16:30:05.384871 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-5c500057-0c2d-4e58-a191-42f5feb9ac17 admin admin] Request method failure captured: Sep 01 16:30:05.384871 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 01 16:30:05.384871 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: Accept: application/json Sep 01 16:30:05.384871 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: Accept-Encoding: gzip, deflate Sep 01 16:30:05.384871 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: Connection: keep-alive Sep 01 16:30:05.384871 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: Content-Length: 0 Sep 01 16:30:05.384871 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: Host: 10.222.0.62 Sep 01 16:30:05.384871 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: Openstack-Api-Version: compute 2.90 Sep 01 16:30:05.384871 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: Openstack-System-Scope: None Sep 01 16:30:05.384871 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: User-Agent: python-novaclient Sep 01 16:30:05.384871 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Auth-Token: gAAAAABjEN4M3TJOKPtZ0rlIxsrY_mDGsrxhiB8tegEdMvPmwcBzU2Sy69N79MTKCNONW0bb5oxHua18CWSmYKsITNZ0V0CG9rgUys9GkO7wwhy26NpTt7C6C5PU-yQX_x4r5hjcy7DcR9osc7SamzZzEfWJk6856xHZO_AOjJzlmZPgzfqi8L0 Sep 01 16:30:05.384871 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Domain-Id: None Sep 01 16:30:05.384871 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Domain-Name: None Sep 01 16:30:05.384871 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Identity-Status: Confirmed Sep 01 16:30:05.384871 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Is-Admin-Project: True Sep 01 16:30:05.384871 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 16:30:05.384871 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Project-Domain-Id: default Sep 01 16:30:05.384871 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Project-Domain-Name: Default Sep 01 16:30:05.384871 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Project-Id: 026b4ed9c3cf48a48d86818cba23c13c Sep 01 16:30:05.384871 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Project-Name: admin Sep 01 16:30:05.384871 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Role: admin,reader,member Sep 01 16:30:05.384871 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Roles: admin,reader,member Sep 01 16:30:05.386280 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/026b4ed9c3cf48a48d86818cba23c13c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/026b4ed9c3cf48a48d86818cba23c13c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_026b4ed9c3cf48a48d86818cba23c13c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/026b4ed9c3cf48a48d86818cba23c13c"}]}] Sep 01 16:30:05.386280 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Tenant: admin Sep 01 16:30:05.386280 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Tenant-Id: 026b4ed9c3cf48a48d86818cba23c13c Sep 01 16:30:05.386280 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Tenant-Name: admin Sep 01 16:30:05.386280 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-User: admin Sep 01 16:30:05.386280 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-User-Domain-Id: default Sep 01 16:30:05.386280 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-User-Domain-Name: Default Sep 01 16:30:05.386280 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-User-Id: 82b69c02f3fd4ddc81686f03143f0651 Sep 01 16:30:05.386280 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-User-Name: admin Sep 01 16:30:05.386280 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: method: > Sep 01 16:30:05.386280 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: exception: Flavor 84 could not be found. Sep 01 16:30:05.386280 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: action_args: {'id': '84'} Sep 01 16:30:05.386280 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: {{(pid=105740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:30:05.386280 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:30:05.387078 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 16:30:05.387078 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 16:30:05.387078 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 16:30:05.387078 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 16:30:05.387078 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 16:30:05.387078 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 16:30:05.387078 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 16:30:05.387078 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 16:30:05.387078 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 16:30:05.387078 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:30:05.387078 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 16:30:05.387078 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 16:30:05.387078 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 01 16:30:05.387078 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi Sep 01 16:30:05.387078 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:30:05.387078 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi Sep 01 16:30:05.387078 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:30:05.387078 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:30:05.387078 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:30:05.388299 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:30:05.388299 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:30:05.388299 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:30:05.388299 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:30:05.388299 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 16:30:05.388299 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:30:05.388299 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 01 16:30:05.388299 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi Sep 01 16:30:05.388299 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:30:05.388299 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi Sep 01 16:30:05.388299 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:30:05.388299 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:30:05.388299 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:30:05.388299 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:30:05.388299 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:30:05.388299 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 01 16:30:05.388299 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi Sep 01 16:30:05.388299 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-5c500057-0c2d-4e58-a191-42f5feb9ac17 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:30:05.389553 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO nova.api.openstack.requestlog [None req-5c500057-0c2d-4e58-a191-42f5feb9ac17 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.449153 Sep 01 16:30:05.389553 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: [pid: 105740|app: 0|req: 23/44] 10.222.0.62 () {60 vars in 1190 bytes} [Thu Sep 1 16:30:04 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 450 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 16:30:05.397775 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi [None req-f094ad5d-0b3a-4b04-9204-1e8c362ee3bf admin admin] Calling method '>' {{(pid=105741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:30:05.413398 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: INFO nova.api.openstack.requestlog [None req-f094ad5d-0b3a-4b04-9204-1e8c362ee3bf admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019534 Sep 01 16:30:05.414027 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: [pid: 105741|app: 0|req: 22/45] 10.222.0.62 () {60 vars in 1210 bytes} [Thu Sep 1 16:30:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:30:05.424057 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-d011521e-4eae-488f-ab9c-11899fee7e92 admin admin] Calling method '>' {{(pid=105740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:30:05.439655 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO nova.api.openstack.requestlog [None req-d011521e-4eae-488f-ab9c-11899fee7e92 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019302 Sep 01 16:30:05.440221 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: [pid: 105740|app: 0|req: 24/46] 10.222.0.62 () {60 vars in 1210 bytes} [Thu Sep 1 16:30:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:30:05.449846 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi [None req-5625a7d9-403f-48ed-9202-d196ae7fdbb3 admin admin] Calling method '>' {{(pid=105741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:30:05.455996 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: INFO nova.api.openstack.wsgi [None req-5625a7d9-403f-48ed-9202-d196ae7fdbb3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 01 16:30:05.457510 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi [None req-5625a7d9-403f-48ed-9202-d196ae7fdbb3 admin admin] Request method failure captured: Sep 01 16:30:05.457510 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 01 16:30:05.457510 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: Accept: application/json Sep 01 16:30:05.457510 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: Accept-Encoding: gzip, deflate Sep 01 16:30:05.457510 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: Connection: keep-alive Sep 01 16:30:05.457510 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: Content-Length: 0 Sep 01 16:30:05.457510 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: Host: 10.222.0.62 Sep 01 16:30:05.457510 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: Openstack-Api-Version: compute 2.90 Sep 01 16:30:05.457510 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: Openstack-System-Scope: None Sep 01 16:30:05.457510 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: User-Agent: python-novaclient Sep 01 16:30:05.457510 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Auth-Token: gAAAAABjEN4M3TJOKPtZ0rlIxsrY_mDGsrxhiB8tegEdMvPmwcBzU2Sy69N79MTKCNONW0bb5oxHua18CWSmYKsITNZ0V0CG9rgUys9GkO7wwhy26NpTt7C6C5PU-yQX_x4r5hjcy7DcR9osc7SamzZzEfWJk6856xHZO_AOjJzlmZPgzfqi8L0 Sep 01 16:30:05.457510 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Domain-Id: None Sep 01 16:30:05.457510 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Domain-Name: None Sep 01 16:30:05.457510 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Identity-Status: Confirmed Sep 01 16:30:05.457510 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Is-Admin-Project: True Sep 01 16:30:05.457510 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 16:30:05.457510 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Project-Domain-Id: default Sep 01 16:30:05.457510 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Project-Domain-Name: Default Sep 01 16:30:05.457510 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Project-Id: 026b4ed9c3cf48a48d86818cba23c13c Sep 01 16:30:05.457510 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Project-Name: admin Sep 01 16:30:05.457510 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Role: admin,reader,member Sep 01 16:30:05.457510 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Roles: admin,reader,member Sep 01 16:30:05.458971 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/026b4ed9c3cf48a48d86818cba23c13c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/026b4ed9c3cf48a48d86818cba23c13c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_026b4ed9c3cf48a48d86818cba23c13c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/026b4ed9c3cf48a48d86818cba23c13c"}]}] Sep 01 16:30:05.458971 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Tenant: admin Sep 01 16:30:05.458971 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Tenant-Id: 026b4ed9c3cf48a48d86818cba23c13c Sep 01 16:30:05.458971 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Tenant-Name: admin Sep 01 16:30:05.458971 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-User: admin Sep 01 16:30:05.458971 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-User-Domain-Id: default Sep 01 16:30:05.458971 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-User-Domain-Name: Default Sep 01 16:30:05.458971 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-User-Id: 82b69c02f3fd4ddc81686f03143f0651 Sep 01 16:30:05.458971 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-User-Name: admin Sep 01 16:30:05.458971 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: method: > Sep 01 16:30:05.458971 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: exception: Flavor 84 could not be found. Sep 01 16:30:05.458971 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: action_args: {'id': '84'} Sep 01 16:30:05.458971 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: {{(pid=105741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:30:05.458971 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:30:05.460404 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 16:30:05.460404 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 16:30:05.460404 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 16:30:05.460404 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 16:30:05.460404 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 16:30:05.460404 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 16:30:05.460404 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 16:30:05.460404 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 16:30:05.460404 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 16:30:05.460404 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:30:05.460404 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 16:30:05.460404 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 16:30:05.460404 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 01 16:30:05.460404 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi Sep 01 16:30:05.460404 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:30:05.460404 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi Sep 01 16:30:05.460404 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:30:05.460404 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:30:05.460404 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:30:05.461678 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:30:05.461678 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:30:05.461678 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:30:05.461678 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:30:05.461678 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 16:30:05.461678 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:30:05.461678 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 01 16:30:05.461678 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi Sep 01 16:30:05.461678 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:30:05.461678 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi Sep 01 16:30:05.461678 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:30:05.461678 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:30:05.461678 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:30:05.461678 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:30:05.461678 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:30:05.461678 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 01 16:30:05.461678 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi Sep 01 16:30:05.461678 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi [None req-5625a7d9-403f-48ed-9202-d196ae7fdbb3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:30:05.462932 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: INFO nova.api.openstack.requestlog [None req-5625a7d9-403f-48ed-9202-d196ae7fdbb3 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012694 Sep 01 16:30:05.462932 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: [pid: 105741|app: 0|req: 23/47] 10.222.0.62 () {60 vars in 1190 bytes} [Thu Sep 1 16:30:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 16:30:06.473360 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-d011521e-4eae-488f-ab9c-11899fee7e92 admin admin] Calling method '>' {{(pid=105740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:30:06.474372 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO nova.api.openstack.requestlog [None req-d011521e-4eae-488f-ab9c-11899fee7e92 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Sep 01 16:30:06.475145 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: [pid: 105740|app: 0|req: 25/48] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Sep 1 16:30:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:30:07.053643 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi [None req-1ed8ca03-1bc0-419b-ae33-4140971da941 admin admin] Calling method '>' {{(pid=105741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:30:07.059775 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: INFO nova.api.openstack.wsgi [None req-1ed8ca03-1bc0-419b-ae33-4140971da941 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 01 16:30:07.061342 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi [None req-1ed8ca03-1bc0-419b-ae33-4140971da941 admin admin] Request method failure captured: Sep 01 16:30:07.061342 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 01 16:30:07.061342 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: Accept: application/json Sep 01 16:30:07.061342 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: Accept-Encoding: gzip, deflate Sep 01 16:30:07.061342 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: Connection: keep-alive Sep 01 16:30:07.061342 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: Content-Length: 0 Sep 01 16:30:07.061342 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: Host: 10.222.0.62 Sep 01 16:30:07.061342 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: Openstack-Api-Version: compute 2.90 Sep 01 16:30:07.061342 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: Openstack-System-Scope: None Sep 01 16:30:07.061342 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: User-Agent: python-novaclient Sep 01 16:30:07.061342 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Auth-Token: gAAAAABjEN4ONj-Arv4orYq-HOJTnJiRKxdY06Rh08LZV2FX64-BCs5bDOe0BoiUVeokwN0HGVMQIEKO9CCvrbVKH9odKGfCWmfKEvjO5Yk7pIMyXI4N5jlue52p7TJAJyQlPr7kLNCi02_Uc8CRM4PikPcMa9S8Z4tPXSVrqOwHeFV7x2eTufI Sep 01 16:30:07.061342 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Domain-Id: None Sep 01 16:30:07.061342 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Domain-Name: None Sep 01 16:30:07.061342 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Identity-Status: Confirmed Sep 01 16:30:07.061342 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Is-Admin-Project: True Sep 01 16:30:07.061342 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 16:30:07.061342 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Project-Domain-Id: default Sep 01 16:30:07.061342 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Project-Domain-Name: Default Sep 01 16:30:07.061342 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Project-Id: 026b4ed9c3cf48a48d86818cba23c13c Sep 01 16:30:07.061342 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Project-Name: admin Sep 01 16:30:07.061342 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Role: admin,reader,member Sep 01 16:30:07.061342 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Roles: admin,reader,member Sep 01 16:30:07.062953 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/026b4ed9c3cf48a48d86818cba23c13c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/026b4ed9c3cf48a48d86818cba23c13c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_026b4ed9c3cf48a48d86818cba23c13c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/026b4ed9c3cf48a48d86818cba23c13c"}]}] Sep 01 16:30:07.062953 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Tenant: admin Sep 01 16:30:07.062953 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Tenant-Id: 026b4ed9c3cf48a48d86818cba23c13c Sep 01 16:30:07.062953 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-Tenant-Name: admin Sep 01 16:30:07.062953 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-User: admin Sep 01 16:30:07.062953 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-User-Domain-Id: default Sep 01 16:30:07.062953 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-User-Domain-Name: Default Sep 01 16:30:07.062953 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-User-Id: 82b69c02f3fd4ddc81686f03143f0651 Sep 01 16:30:07.062953 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: X-User-Name: admin Sep 01 16:30:07.062953 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: method: > Sep 01 16:30:07.062953 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: exception: Flavor 451 could not be found. Sep 01 16:30:07.062953 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: action_args: {'id': '451'} Sep 01 16:30:07.062953 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: {{(pid=105741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:30:07.062953 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:30:07.063861 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 16:30:07.063861 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 16:30:07.063861 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 16:30:07.063861 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 16:30:07.063861 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 16:30:07.063861 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 16:30:07.063861 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 16:30:07.063861 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 16:30:07.063861 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 16:30:07.063861 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:30:07.063861 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 16:30:07.063861 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 16:30:07.063861 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 01 16:30:07.063861 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi Sep 01 16:30:07.063861 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:30:07.063861 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi Sep 01 16:30:07.063861 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:30:07.063861 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:30:07.063861 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:30:07.065227 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:30:07.065227 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:30:07.065227 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:30:07.065227 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:30:07.065227 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 16:30:07.065227 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:30:07.065227 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 01 16:30:07.065227 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi Sep 01 16:30:07.065227 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:30:07.065227 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi Sep 01 16:30:07.065227 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:30:07.065227 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:30:07.065227 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:30:07.065227 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:30:07.065227 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:30:07.065227 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 01 16:30:07.065227 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: ERROR nova.api.openstack.wsgi Sep 01 16:30:07.065227 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi [None req-1ed8ca03-1bc0-419b-ae33-4140971da941 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:30:07.066396 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: INFO nova.api.openstack.requestlog [None req-1ed8ca03-1bc0-419b-ae33-4140971da941 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.443015 Sep 01 16:30:07.066396 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: [pid: 105741|app: 0|req: 24/49] 10.222.0.62 () {60 vars in 1193 bytes} [Thu Sep 1 16:30:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 444 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 16:30:07.073164 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-21f2385a-26c7-4fd0-bc5d-f8aa891a05c5 admin admin] Calling method '>' {{(pid=105740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:30:07.089028 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO nova.api.openstack.requestlog [None req-21f2385a-26c7-4fd0-bc5d-f8aa891a05c5 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019727 Sep 01 16:30:07.089584 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: [pid: 105740|app: 0|req: 26/50] 10.222.0.62 () {60 vars in 1210 bytes} [Thu Sep 1 16:30:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:30:07.099369 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi [None req-a4c3543f-874d-4965-a2cb-530c99974717 admin admin] Calling method '>' {{(pid=105741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:30:07.114571 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: INFO nova.api.openstack.requestlog [None req-a4c3543f-874d-4965-a2cb-530c99974717 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018857 Sep 01 16:30:07.115084 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: [pid: 105741|app: 0|req: 25/51] 10.222.0.62 () {60 vars in 1210 bytes} [Thu Sep 1 16:30:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:30:07.124383 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-6d428e0c-12dc-49dc-a28c-a5d2b95fc930 admin admin] Calling method '>' {{(pid=105740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:30:07.130310 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO nova.api.openstack.wsgi [None req-6d428e0c-12dc-49dc-a28c-a5d2b95fc930 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 01 16:30:07.131854 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-6d428e0c-12dc-49dc-a28c-a5d2b95fc930 admin admin] Request method failure captured: Sep 01 16:30:07.131854 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 01 16:30:07.131854 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: Accept: application/json Sep 01 16:30:07.131854 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: Accept-Encoding: gzip, deflate Sep 01 16:30:07.131854 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: Connection: keep-alive Sep 01 16:30:07.131854 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: Content-Length: 0 Sep 01 16:30:07.131854 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: Host: 10.222.0.62 Sep 01 16:30:07.131854 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: Openstack-Api-Version: compute 2.90 Sep 01 16:30:07.131854 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: Openstack-System-Scope: None Sep 01 16:30:07.131854 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: User-Agent: python-novaclient Sep 01 16:30:07.131854 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Auth-Token: gAAAAABjEN4ONj-Arv4orYq-HOJTnJiRKxdY06Rh08LZV2FX64-BCs5bDOe0BoiUVeokwN0HGVMQIEKO9CCvrbVKH9odKGfCWmfKEvjO5Yk7pIMyXI4N5jlue52p7TJAJyQlPr7kLNCi02_Uc8CRM4PikPcMa9S8Z4tPXSVrqOwHeFV7x2eTufI Sep 01 16:30:07.131854 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Domain-Id: None Sep 01 16:30:07.131854 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Domain-Name: None Sep 01 16:30:07.131854 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Identity-Status: Confirmed Sep 01 16:30:07.131854 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Is-Admin-Project: True Sep 01 16:30:07.131854 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 16:30:07.131854 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Project-Domain-Id: default Sep 01 16:30:07.131854 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Project-Domain-Name: Default Sep 01 16:30:07.131854 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Project-Id: 026b4ed9c3cf48a48d86818cba23c13c Sep 01 16:30:07.131854 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Project-Name: admin Sep 01 16:30:07.131854 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Role: admin,reader,member Sep 01 16:30:07.131854 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Roles: admin,reader,member Sep 01 16:30:07.133299 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/026b4ed9c3cf48a48d86818cba23c13c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/026b4ed9c3cf48a48d86818cba23c13c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_026b4ed9c3cf48a48d86818cba23c13c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/026b4ed9c3cf48a48d86818cba23c13c"}]}] Sep 01 16:30:07.133299 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Tenant: admin Sep 01 16:30:07.133299 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Tenant-Id: 026b4ed9c3cf48a48d86818cba23c13c Sep 01 16:30:07.133299 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-Tenant-Name: admin Sep 01 16:30:07.133299 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-User: admin Sep 01 16:30:07.133299 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-User-Domain-Id: default Sep 01 16:30:07.133299 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-User-Domain-Name: Default Sep 01 16:30:07.133299 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-User-Id: 82b69c02f3fd4ddc81686f03143f0651 Sep 01 16:30:07.133299 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: X-User-Name: admin Sep 01 16:30:07.133299 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: method: > Sep 01 16:30:07.133299 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: exception: Flavor 451 could not be found. Sep 01 16:30:07.133299 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: action_args: {'id': '451'} Sep 01 16:30:07.133299 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: {{(pid=105740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:30:07.133299 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:30:07.134658 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 16:30:07.134658 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 16:30:07.134658 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 16:30:07.134658 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 16:30:07.134658 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 16:30:07.134658 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 16:30:07.134658 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 16:30:07.134658 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 16:30:07.134658 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 16:30:07.134658 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:30:07.134658 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 16:30:07.134658 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 16:30:07.134658 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 01 16:30:07.134658 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi Sep 01 16:30:07.134658 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:30:07.134658 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi Sep 01 16:30:07.134658 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:30:07.134658 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:30:07.134658 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:30:07.136579 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:30:07.136579 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:30:07.136579 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:30:07.136579 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:30:07.136579 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 16:30:07.136579 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:30:07.136579 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 01 16:30:07.136579 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi Sep 01 16:30:07.136579 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:30:07.136579 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi Sep 01 16:30:07.136579 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:30:07.136579 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:30:07.136579 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:30:07.136579 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:30:07.136579 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:30:07.136579 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 01 16:30:07.136579 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: ERROR nova.api.openstack.wsgi Sep 01 16:30:07.136579 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-6d428e0c-12dc-49dc-a28c-a5d2b95fc930 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:30:07.138084 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO nova.api.openstack.requestlog [None req-6d428e0c-12dc-49dc-a28c-a5d2b95fc930 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012430 Sep 01 16:30:07.138084 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: [pid: 105740|app: 0|req: 27/52] 10.222.0.62 () {60 vars in 1193 bytes} [Thu Sep 1 16:30:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 16:30:08.138912 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi [None req-a4c3543f-874d-4965-a2cb-530c99974717 admin admin] Calling method '>' {{(pid=105741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:30:08.140324 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: INFO nova.api.openstack.requestlog [None req-a4c3543f-874d-4965-a2cb-530c99974717 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002006 Sep 01 16:30:08.140886 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: [pid: 105741|app: 0|req: 26/53] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Sep 1 16:30:08 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:30:08.713035 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-f047753f-8aaa-4e88-a2f2-0cabad010ece admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:30:08.735278 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO nova.api.openstack.requestlog [None req-f047753f-8aaa-4e88-a2f2-0cabad010ece admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.451529 Sep 01 16:30:08.735834 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: [pid: 105740|app: 0|req: 28/54] 10.222.0.62 () {64 vars in 1235 bytes} [Thu Sep 1 16:30:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:30:09.729353 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi [None req-a4c3543f-874d-4965-a2cb-530c99974717 admin admin] Calling method '>' {{(pid=105741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:30:09.730941 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: INFO nova.api.openstack.requestlog [None req-a4c3543f-874d-4965-a2cb-530c99974717 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002185 Sep 01 16:30:09.731526 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: [pid: 105741|app: 0|req: 27/55] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Sep 1 16:30:09 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:30:10.300863 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-e83e6d18-ac7a-4e1f-92fb-4ddbd962d4de admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:30:10.323146 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO nova.api.openstack.requestlog [None req-e83e6d18-ac7a-4e1f-92fb-4ddbd962d4de admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.452498 Sep 01 16:30:10.323668 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: [pid: 105740|app: 0|req: 29/56] 10.222.0.62 () {64 vars in 1235 bytes} [Thu Sep 1 16:30:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:30:11.341733 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi [None req-a4c3543f-874d-4965-a2cb-530c99974717 admin admin] Calling method '>' {{(pid=105741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:30:11.342749 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: INFO nova.api.openstack.requestlog [None req-a4c3543f-874d-4965-a2cb-530c99974717 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Sep 01 16:30:11.343159 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: [pid: 105741|app: 0|req: 28/57] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Sep 1 16:30:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:30:11.931481 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-7a5874f4-7455-4792-8214-90cc1164cbc4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:30:11.953157 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO nova.api.openstack.requestlog [None req-7a5874f4-7455-4792-8214-90cc1164cbc4 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.451139 Sep 01 16:30:11.954219 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: [pid: 105740|app: 0|req: 30/58] 10.222.0.62 () {64 vars in 1235 bytes} [Thu Sep 1 16:30:11 2022] POST /compute/v2.1/flavors => generated 407 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:30:12.962459 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi [None req-a4c3543f-874d-4965-a2cb-530c99974717 admin admin] Calling method '>' {{(pid=105741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:30:12.963476 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: INFO nova.api.openstack.requestlog [None req-a4c3543f-874d-4965-a2cb-530c99974717 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Sep 01 16:30:12.963915 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: [pid: 105741|app: 0|req: 29/59] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Sep 1 16:30:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:30:13.527835 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-6ea48239-2c8a-498a-8a8e-d3d861eba17d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:30:13.550332 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO nova.api.openstack.requestlog [None req-6ea48239-2c8a-498a-8a8e-d3d861eba17d admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.452357 Sep 01 16:30:13.550871 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: [pid: 105740|app: 0|req: 31/60] 10.222.0.62 () {64 vars in 1235 bytes} [Thu Sep 1 16:30:13 2022] POST /compute/v2.1/flavors => generated 409 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:30:14.541595 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi [None req-a4c3543f-874d-4965-a2cb-530c99974717 admin admin] Calling method '>' {{(pid=105741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:30:14.542614 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: INFO nova.api.openstack.requestlog [None req-a4c3543f-874d-4965-a2cb-530c99974717 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Sep 01 16:30:14.543031 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: [pid: 105741|app: 0|req: 30/61] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Sep 1 16:30:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:30:15.114420 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-ebd672d7-a1fe-4f5b-9add-03be7390532c admin admin] Calling method '>' {{(pid=105740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:30:15.135344 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO nova.api.openstack.requestlog [None req-ebd672d7-a1fe-4f5b-9add-03be7390532c admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.457163 Sep 01 16:30:15.135906 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: [pid: 105740|app: 0|req: 32/62] 10.222.0.62 () {60 vars in 1202 bytes} [Thu Sep 1 16:30:14 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:31:09.530985 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi [None req-a4c3543f-874d-4965-a2cb-530c99974717 admin admin] Calling method '>' {{(pid=105741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:09.532031 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: INFO nova.api.openstack.requestlog [None req-a4c3543f-874d-4965-a2cb-530c99974717 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Sep 01 16:31:09.532676 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: [pid: 105741|app: 0|req: 31/63] 10.222.0.62 () {54 vars in 931 bytes} [Thu Sep 1 16:31:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:31:09.546916 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG dbcounter [-] [105740] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:31:09.960397 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-05fb1a67-3612-486d-a511-57ca77019157 admin admin] Calling method '>' {{(pid=105740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:09.981656 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO nova.api.openstack.requestlog [None req-05fb1a67-3612-486d-a511-57ca77019157 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.442726 Sep 01 16:31:09.982211 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: [pid: 105740|app: 0|req: 33/64] 10.222.0.62 () {60 vars in 1292 bytes} [Thu Sep 1 16:31:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:31:10.009032 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG dbcounter [-] [105741] Writing DB stats nova_api:SELECT=14 {{(pid=105741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:31:10.014183 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi [None req-bc8a9624-75b8-47c1-8f27-c85f75fbd620 admin admin] Calling method '>' {{(pid=105741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:10.022376 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: INFO nova.api.openstack.requestlog [None req-bc8a9624-75b8-47c1-8f27-c85f75fbd620 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016430 Sep 01 16:31:10.022902 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: [pid: 105741|app: 0|req: 32/65] 10.222.0.62 () {60 vars in 1283 bytes} [Thu Sep 1 16:31:10 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:10.035312 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-afb128ff-84eb-443f-affa-ad9c09d15c62 admin admin] Calling method '>' {{(pid=105740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:10.043563 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO nova.api.openstack.requestlog [None req-afb128ff-84eb-443f-affa-ad9c09d15c62 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011697 Sep 01 16:31:10.044135 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: [pid: 105740|app: 0|req: 34/66] 10.222.0.62 () {60 vars in 1286 bytes} [Thu Sep 1 16:31:10 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:10.056225 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi [None req-17fb1e29-05af-4b8f-ba0d-e065cf34b5c5 admin admin] Calling method '>' {{(pid=105741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:10.064176 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: INFO nova.api.openstack.requestlog [None req-17fb1e29-05af-4b8f-ba0d-e065cf34b5c5 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011551 Sep 01 16:31:10.064698 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: [pid: 105741|app: 0|req: 33/67] 10.222.0.62 () {60 vars in 1286 bytes} [Thu Sep 1 16:31:10 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:10.080333 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-59210bdb-2412-413a-a014-7f2b9e3ddfca admin admin] Calling method '>' {{(pid=105740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:10.088187 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO nova.api.openstack.requestlog [None req-59210bdb-2412-413a-a014-7f2b9e3ddfca admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011914 Sep 01 16:31:10.088699 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: [pid: 105740|app: 0|req: 35/68] 10.222.0.62 () {60 vars in 1283 bytes} [Thu Sep 1 16:31:10 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:13.980039 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi [None req-17fb1e29-05af-4b8f-ba0d-e065cf34b5c5 admin admin] Calling method '>' {{(pid=105741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:13.981084 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: INFO nova.api.openstack.requestlog [None req-17fb1e29-05af-4b8f-ba0d-e065cf34b5c5 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Sep 01 16:34:13.981756 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: [pid: 105741|app: 0|req: 34/69] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Sep 1 16:34:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:34:14.121796 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG dbcounter [-] [105740] Writing DB stats nova_api:SELECT=6 {{(pid=105740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:14.306820 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-abd380b4-21a6-4dc4-9fbc-35a48d38a417 admin admin] Calling method '>' {{(pid=105740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:14.310366 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG oslo_concurrency.lockutils [None req-abd380b4-21a6-4dc4-9fbc-35a48d38a417 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:14.310829 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG oslo_concurrency.lockutils [None req-abd380b4-21a6-4dc4-9fbc-35a48d38a417 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:14.311248 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG oslo_concurrency.lockutils [None req-abd380b4-21a6-4dc4-9fbc-35a48d38a417 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:14.312021 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG oslo_concurrency.lockutils [None req-abd380b4-21a6-4dc4-9fbc-35a48d38a417 admin admin] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:14.312459 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG oslo_concurrency.lockutils [None req-abd380b4-21a6-4dc4-9fbc-35a48d38a417 admin admin] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:14.312866 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG oslo_concurrency.lockutils [None req-abd380b4-21a6-4dc4-9fbc-35a48d38a417 admin admin] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:14.347721 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO nova.api.openstack.requestlog [None req-abd380b4-21a6-4dc4-9fbc-35a48d38a417 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.227430 Sep 01 16:34:14.348299 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: [pid: 105740|app: 0|req: 36/70] 10.222.0.62 () {60 vars in 1193 bytes} [Thu Sep 1 16:34:14 2022] GET /compute/v2.1/os-services => generated 791 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 16:34:15.217342 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi [None req-17fb1e29-05af-4b8f-ba0d-e065cf34b5c5 admin admin] Calling method '>' {{(pid=105741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:15.218401 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: INFO nova.api.openstack.requestlog [None req-17fb1e29-05af-4b8f-ba0d-e065cf34b5c5 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001749 Sep 01 16:34:15.218812 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: [pid: 105741|app: 0|req: 35/71] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Sep 1 16:34:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:34:15.416189 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-b4392230-f64c-41b1-9e5e-8b4716080a0b admin admin] Calling method '>' {{(pid=105740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:15.420587 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG oslo_concurrency.lockutils [None req-b4392230-f64c-41b1-9e5e-8b4716080a0b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:15.421060 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG oslo_concurrency.lockutils [None req-b4392230-f64c-41b1-9e5e-8b4716080a0b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:15.421482 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG oslo_concurrency.lockutils [None req-b4392230-f64c-41b1-9e5e-8b4716080a0b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:15.422208 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG oslo_concurrency.lockutils [None req-b4392230-f64c-41b1-9e5e-8b4716080a0b admin admin] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:15.422648 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG oslo_concurrency.lockutils [None req-b4392230-f64c-41b1-9e5e-8b4716080a0b admin admin] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:15.423056 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG oslo_concurrency.lockutils [None req-b4392230-f64c-41b1-9e5e-8b4716080a0b admin admin] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:15.442833 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO nova.api.openstack.requestlog [None req-b4392230-f64c-41b1-9e5e-8b4716080a0b admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.085631 Sep 01 16:34:15.443364 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: [pid: 105740|app: 0|req: 37/72] 10.222.0.62 () {60 vars in 1193 bytes} [Thu Sep 1 16:34:15 2022] GET /compute/v2.1/os-services => generated 791 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:34:26.713166 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi [None req-17fb1e29-05af-4b8f-ba0d-e065cf34b5c5 admin admin] Calling method '>' {{(pid=105741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:26.714485 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: INFO nova.api.openstack.requestlog [None req-17fb1e29-05af-4b8f-ba0d-e065cf34b5c5 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002059 Sep 01 16:34:26.714949 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: [pid: 105741|app: 0|req: 36/73] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Sep 1 16:34:26 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:34:26.864196 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG dbcounter [-] [105740] Writing DB stats nova_cell0:SELECT=4 {{(pid=105740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:26.864951 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG dbcounter [-] [105740] Writing DB stats nova_cell1:SELECT=4 {{(pid=105740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:26.865709 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG dbcounter [-] [105740] Writing DB stats nova_api:SELECT=8 {{(pid=105740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:26.916880 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-08424181-2fba-4678-b7f3-2ad07ab60429 admin admin] Calling method '>' {{(pid=105740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:26.920462 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG oslo_concurrency.lockutils [None req-08424181-2fba-4678-b7f3-2ad07ab60429 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:26.920940 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG oslo_concurrency.lockutils [None req-08424181-2fba-4678-b7f3-2ad07ab60429 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:26.921372 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG oslo_concurrency.lockutils [None req-08424181-2fba-4678-b7f3-2ad07ab60429 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:26.922094 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG oslo_concurrency.lockutils [None req-08424181-2fba-4678-b7f3-2ad07ab60429 admin admin] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:26.922539 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG oslo_concurrency.lockutils [None req-08424181-2fba-4678-b7f3-2ad07ab60429 admin admin] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:26.923024 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG oslo_concurrency.lockutils [None req-08424181-2fba-4678-b7f3-2ad07ab60429 admin admin] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:26.948549 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO nova.api.openstack.requestlog [None req-08424181-2fba-4678-b7f3-2ad07ab60429 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.091596 Sep 01 16:34:26.949100 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: [pid: 105740|app: 0|req: 38/74] 10.222.0.62 () {60 vars in 1193 bytes} [Thu Sep 1 16:34:26 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:27.803291 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: DEBUG nova.api.openstack.wsgi [None req-17fb1e29-05af-4b8f-ba0d-e065cf34b5c5 admin admin] Calling method '>' {{(pid=105741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:27.804351 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: INFO nova.api.openstack.requestlog [None req-17fb1e29-05af-4b8f-ba0d-e065cf34b5c5 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Sep 01 16:34:27.804753 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: [pid: 105741|app: 0|req: 37/75] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Sep 1 16:34:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:34:28.013265 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG nova.api.openstack.wsgi [None req-5c2a8d80-c879-42f5-ab41-c01152999220 admin admin] Calling method '>' {{(pid=105740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:28.016767 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG oslo_concurrency.lockutils [None req-5c2a8d80-c879-42f5-ab41-c01152999220 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:28.017282 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG oslo_concurrency.lockutils [None req-5c2a8d80-c879-42f5-ab41-c01152999220 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:28.017747 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG oslo_concurrency.lockutils [None req-5c2a8d80-c879-42f5-ab41-c01152999220 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:28.018463 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG oslo_concurrency.lockutils [None req-5c2a8d80-c879-42f5-ab41-c01152999220 admin admin] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:28.018909 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG oslo_concurrency.lockutils [None req-5c2a8d80-c879-42f5-ab41-c01152999220 admin admin] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:28.019328 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: DEBUG oslo_concurrency.lockutils [None req-5c2a8d80-c879-42f5-ab41-c01152999220 admin admin] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:28.042341 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: INFO nova.api.openstack.requestlog [None req-5c2a8d80-c879-42f5-ab41-c01152999220 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.091675 Sep 01 16:34:28.042902 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: [pid: 105740|app: 0|req: 39/76] 10.222.0.62 () {60 vars in 1193 bytes} [Thu Sep 1 16:34:27 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:35:24.975622 dv-cinder-852210-9-iscsi devstack@n-api.service[105737]: Thu Sep 1 16:35:24 2022 - graceful shutdown triggered... Sep 01 16:35:24.976498 dv-cinder-852210-9-iscsi devstack@n-api.service[105740]: Gracefully killing worker 1 (pid: 105740)... Sep 01 16:35:24.975744 dv-cinder-852210-9-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 01 16:35:24.977306 dv-cinder-852210-9-iscsi devstack@n-api.service[105741]: Gracefully killing worker 2 (pid: 105741)... Sep 01 16:35:25.976915 dv-cinder-852210-9-iscsi devstack@n-api.service[105737]: worker 1 buried after 1 seconds Sep 01 16:35:25.977703 dv-cinder-852210-9-iscsi devstack@n-api.service[105737]: worker 2 buried after 1 seconds Sep 01 16:35:25.977703 dv-cinder-852210-9-iscsi devstack@n-api.service[105737]: goodbye to uWSGI. Sep 01 16:35:25.979329 dv-cinder-852210-9-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 01 16:35:25.980268 dv-cinder-852210-9-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 01 16:35:25.984288 dv-cinder-852210-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 01 16:35:25.996233 dv-cinder-852210-9-iscsi devstack@n-api.service[127176]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 01 16:35:25.998436 dv-cinder-852210-9-iscsi devstack@n-api.service[127176]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 16:35:25 2022] *** Sep 01 16:35:25.998436 dv-cinder-852210-9-iscsi devstack@n-api.service[127176]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 16:35:25.998436 dv-cinder-852210-9-iscsi devstack@n-api.service[127176]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 16:35:25.998436 dv-cinder-852210-9-iscsi devstack@n-api.service[127176]: nodename: dv-cinder-852210-9-iscsi Sep 01 16:35:25.998436 dv-cinder-852210-9-iscsi devstack@n-api.service[127176]: machine: x86_64 Sep 01 16:35:25.998436 dv-cinder-852210-9-iscsi devstack@n-api.service[127176]: clock source: unix Sep 01 16:35:25.998436 dv-cinder-852210-9-iscsi devstack@n-api.service[127176]: pcre jit disabled Sep 01 16:35:25.998436 dv-cinder-852210-9-iscsi devstack@n-api.service[127176]: detected number of CPU cores: 4 Sep 01 16:35:25.998436 dv-cinder-852210-9-iscsi devstack@n-api.service[127176]: current working directory: / Sep 01 16:35:25.998436 dv-cinder-852210-9-iscsi devstack@n-api.service[127176]: detected binary path: /usr/bin/uwsgi-core Sep 01 16:35:25.998436 dv-cinder-852210-9-iscsi devstack@n-api.service[127176]: your processes number limit is 47680 Sep 01 16:35:25.999431 dv-cinder-852210-9-iscsi devstack@n-api.service[127176]: your memory page size is 4096 bytes Sep 01 16:35:25.999431 dv-cinder-852210-9-iscsi devstack@n-api.service[127176]: detected max file descriptor number: 2048 Sep 01 16:35:25.999431 dv-cinder-852210-9-iscsi devstack@n-api.service[127176]: lock engine: pthread robust mutexes Sep 01 16:35:25.999431 dv-cinder-852210-9-iscsi devstack@n-api.service[127176]: thunder lock: enabled Sep 01 16:35:25.999431 dv-cinder-852210-9-iscsi devstack@n-api.service[127176]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 01 16:35:25.999431 dv-cinder-852210-9-iscsi devstack@n-api.service[127176]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 16:35:26.045154 dv-cinder-852210-9-iscsi devstack@n-api.service[127176]: Python main interpreter initialized at 0x562c72f609c0 Sep 01 16:35:26.045154 dv-cinder-852210-9-iscsi devstack@n-api.service[127176]: python threads support enabled Sep 01 16:35:26.045154 dv-cinder-852210-9-iscsi devstack@n-api.service[127176]: your server socket listen backlog is limited to 100 connections Sep 01 16:35:26.045154 dv-cinder-852210-9-iscsi devstack@n-api.service[127176]: your mercy for graceful operations on workers is 90 seconds Sep 01 16:35:26.045664 dv-cinder-852210-9-iscsi devstack@n-api.service[127176]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 16:35:26.045664 dv-cinder-852210-9-iscsi devstack@n-api.service[127176]: *** Operational MODE: preforking *** Sep 01 16:35:26.045864 dv-cinder-852210-9-iscsi devstack@n-api.service[127176]: *** uWSGI is running in multiple interpreter mode *** Sep 01 16:35:26.045864 dv-cinder-852210-9-iscsi devstack@n-api.service[127176]: spawned uWSGI master process (pid: 127176) Sep 01 16:35:26.046086 dv-cinder-852210-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 01 16:35:26.046865 dv-cinder-852210-9-iscsi devstack@n-api.service[127176]: spawned uWSGI worker 1 (pid: 127198, cores: 1) Sep 01 16:35:26.048245 dv-cinder-852210-9-iscsi devstack@n-api.service[127176]: spawned uWSGI worker 2 (pid: 127199, cores: 1) Sep 01 16:35:26.048245 dv-cinder-852210-9-iscsi devstack@n-api.service[127176]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 16:35:26.710667 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 16:35:26.732507 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 16:35:27.860990 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:35:27.860990 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: from cryptography.utils import int_from_bytes Sep 01 16:35:27.861707 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:35:27.861707 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: from cryptography.utils import int_from_bytes Sep 01 16:35:27.905308 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:35:27.905308 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: from cryptography.utils import int_from_bytes Sep 01 16:35:27.905937 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:35:27.905937 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: from cryptography.utils import int_from_bytes Sep 01 16:35:30.290622 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 16:35:30.290622 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 16:35:30.291081 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 16:35:30.291081 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 16:35:30.291487 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 16:35:30.291719 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.292092 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.292425 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.292754 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.293096 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.293448 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.293778 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.294112 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.294453 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.294680 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.295006 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.295432 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-9-iscsi {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.296039 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.296358 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.296681 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.296990 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.297300 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.297624 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.297976 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.298464 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.300218 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.300544 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.300864 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.301238 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.301545 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.301878 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.302187 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.302737 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.302854 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.303149 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.303582 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-9-iscsi {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.304051 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.304256 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.304573 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.305012 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.305337 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.305659 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.305974 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.306324 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.306666 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.307001 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.307335 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.307654 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.307997 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.308310 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.308624 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.308944 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.309274 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.309583 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.309912 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.310169 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.310480 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.310808 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.311171 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.311663 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.312144 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.312414 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.312749 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.313083 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.313406 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.313704 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.314037 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.314351 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.314666 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.314977 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.315282 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.315646 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.316008 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.316339 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.316674 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.316984 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.317308 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.317742 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.317995 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.318302 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.318668 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.318993 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.319308 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.319634 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.320038 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.320323 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.320634 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.320952 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.321293 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.321637 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.321944 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.322198 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.322515 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.322824 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.323147 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.323458 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.323772 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.324121 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.324432 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.324739 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.325049 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.325363 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.325670 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.326107 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.326298 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.326648 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.326979 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.327283 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.327694 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.328055 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.328387 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.328701 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.329022 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.329357 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.329969 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.330291 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.330601 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.330917 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.331246 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.331554 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.331864 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.332207 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.332520 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.332834 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.333157 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.333465 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.333782 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.334103 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.334417 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.334728 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.335038 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.335347 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.335656 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.335986 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.336317 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.336598 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.336906 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.337234 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.337568 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.337879 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.338212 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.338517 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.338835 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.339180 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.339521 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.339870 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.340200 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.340558 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.340895 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.341217 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.341532 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.341852 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.342223 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.342554 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.343087 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.343584 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.343962 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.344270 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.344613 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.344933 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.345257 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.345582 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.345895 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.346223 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.346563 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.346894 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.347209 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.347557 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.347932 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.348253 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.348586 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.348934 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.349245 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.349560 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.349871 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.350230 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.350528 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.350841 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.351168 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.351485 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.351820 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.352167 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.352483 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.352800 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.353114 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.353450 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.353809 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.354129 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.354458 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.354779 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.355104 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.355423 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.355738 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.356079 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.356402 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.356703 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.357024 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.357328 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.357642 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.358015 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.358338 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.358676 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.359109 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.359339 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.359629 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.360002 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.360306 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.360600 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.360911 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.361844 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.361844 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.361844 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.362329 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.362479 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.362749 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.363076 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.363382 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.363705 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.364218 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.364394 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.364676 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.364992 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.365307 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.365659 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.365970 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.366285 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.366611 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.366953 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.367254 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.367596 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.367943 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.368270 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.368577 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.368891 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.369226 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.369519 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.369824 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.370161 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.370437 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.370744 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.371074 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.371377 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.371681 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.372030 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.372339 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.372646 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.372934 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.373253 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.373636 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.373931 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.374279 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.374705 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.375038 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.375367 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.375686 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.376030 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.376347 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.376666 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.376982 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.377299 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.377626 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.377775 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 16:35:30.378270 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.378474 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 16:35:30.378633 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.378775 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 16:35:30.378914 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.379070 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 16:35:30.379230 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.379413 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 16:35:30.379557 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.379557 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.379818 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.380067 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.380220 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.380368 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.380507 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.380645 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.380784 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.380922 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.381080 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.381080 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.381345 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.381491 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.381637 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.381776 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.381928 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.382068 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.382214 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.382214 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.382476 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.382628 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.382781 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.382934 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-9-iscsi {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.383076 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.383214 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.383350 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.383495 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.383647 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.383795 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.383985 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.384131 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.384278 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.384428 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.384581 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.384731 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.384888 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.385027 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.385171 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.385322 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.385620 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.385774 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.385936 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.386092 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.386253 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.386399 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.386553 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.386710 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.386859 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.387007 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.387153 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.387297 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.387456 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.387600 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.387761 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.388024 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.388186 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.388326 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.388515 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.388674 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.388812 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.388951 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.389164 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.389317 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-9-iscsi {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.389465 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.389604 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.389749 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.390008 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.390163 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.390330 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.390480 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.390653 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.390809 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.390956 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.391109 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.391257 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.391404 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.391571 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.391738 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.391916 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.392076 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.392325 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.392479 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.392627 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.392766 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.392943 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.393092 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.393262 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.393406 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.393578 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.393720 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.393874 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.394013 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.394187 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.394331 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.394497 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.394649 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.394798 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.394959 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.395105 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.395251 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.395397 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.395548 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.395706 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.395852 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.396027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.396178 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.396326 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.396481 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.396629 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.396824 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.397028 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.397203 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.397376 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.397545 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.397701 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.397857 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.397999 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.398139 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.398334 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.398490 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.398702 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.398867 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.398867 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.399230 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.399433 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.399577 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.399716 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.399854 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.400051 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.400194 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.400342 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.400488 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.400634 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.400785 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.400932 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.401072 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.401227 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.401376 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.401515 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.401667 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.401814 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.401993 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.402158 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.402328 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.402507 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.402651 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.402814 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.402995 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.403159 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.403331 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.403518 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.403702 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.403702 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.404143 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.404344 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.404500 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.404689 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.404868 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.405059 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.405261 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.405470 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.405633 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.405774 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.405774 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.406070 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.406238 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.406412 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.406568 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.406722 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.406864 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.407050 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.407203 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.407401 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.407552 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.407751 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.408079 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.408230 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.408380 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.408568 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.408795 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.409003 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.409188 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.409372 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.409532 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.409694 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.409853 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.410000 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.410172 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.410359 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.410574 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.410760 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.410924 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.411065 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.411203 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.411341 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.411479 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.411619 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.411780 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.411947 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.412133 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.412313 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.412505 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.412650 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.412842 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.412984 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.413166 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.413325 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.413325 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.413608 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.413760 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.413910 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.414049 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.414195 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.414344 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.414494 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.414633 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.414781 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.414934 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.415079 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.415224 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.415386 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.415573 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.415745 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.415998 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.416178 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.416326 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.416475 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.416619 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.416851 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.417056 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.417252 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.417443 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.417635 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.417821 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.418016 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.418177 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.418323 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.418504 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.418670 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.418860 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.418860 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.419167 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.419314 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.419467 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.419654 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.419808 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.420039 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.420229 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.420486 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.420677 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.420980 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.421168 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.421372 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.421590 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.421770 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.421919 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.422064 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.422221 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.422376 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.422530 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.422685 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.422851 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.422997 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.423154 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.423307 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.423460 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.423612 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.423612 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.423960 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.424143 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.424300 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.424456 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.424610 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.424610 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.424912 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.424912 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.425203 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:35:30.425356 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.425510 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.425656 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.425815 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.425968 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.426120 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.426272 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.426416 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.426561 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.426716 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.426887 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.427039 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.427193 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.427348 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.427491 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.427645 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.427801 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.427972 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.428121 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.428276 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.428432 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.428586 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.428750 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.428945 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.429114 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.429262 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.429420 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.429577 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.429730 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.429884 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.430036 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.430181 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.430335 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.430490 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.430644 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.430803 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.430956 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.431109 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.431263 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.431416 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.431569 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.431723 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.431929 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.432098 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.432266 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.432419 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.432565 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.432718 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.432873 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.432873 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.433237 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.433392 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.433537 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.433682 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.433836 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.433995 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.434148 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.434309 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.434463 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.434615 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.434779 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.434934 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.435081 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.435233 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.435386 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.435539 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.435694 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.435840 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.436053 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.436267 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.436416 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.436567 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.436722 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.436887 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.437036 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.437180 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.437324 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.437475 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.437635 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.437794 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.437946 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.438102 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.438256 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.438401 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.438559 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.438559 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.438844 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.438844 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.439170 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.439326 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.439487 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.439642 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.439788 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.439976 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.440128 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.440287 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.440433 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.440576 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.440727 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.440882 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.441029 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.441182 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.441327 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.441480 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.441625 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.441778 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.441930 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.442128 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.442316 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.442473 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.442618 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.442798 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.442994 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.443171 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.443326 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.443494 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.443680 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.443852 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.444038 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.444189 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.444334 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.444479 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.444660 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.444822 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.444994 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.445150 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.445150 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.445427 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.445571 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.445715 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.445873 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.446019 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.446163 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.446309 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.446452 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.446611 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.446756 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.446920 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.447066 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.447218 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.447364 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.447522 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.447668 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.447812 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.447992 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.448153 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.448153 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.448449 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.448594 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.448739 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.448901 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.449097 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.449248 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.449409 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.449409 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.449687 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.449848 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.450044 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.450262 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.450503 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.450724 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.450903 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.451063 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.451217 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.451374 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.451571 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.451733 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.451905 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.452116 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.452293 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.452457 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.452606 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.452760 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.452914 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.453060 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.453219 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.453399 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.453602 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.453794 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.453942 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.454086 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.454239 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.454399 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.454891 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.455110 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.455315 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.455509 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.455676 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.455835 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.456058 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.456208 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.456354 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.456498 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.456658 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.456806 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.456950 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.457095 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.457247 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.457247 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.457545 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.457714 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.457890 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.458056 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.458205 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.458398 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.458548 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.458700 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.458855 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.459001 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.459186 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.459351 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.459506 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.459660 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.459820 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.460000 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.460148 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.460308 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.460454 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.460607 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.460759 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.460913 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.461066 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.461220 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.461372 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.461517 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.461661 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.461825 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.461972 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.462130 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.462283 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.462428 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.462587 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.462740 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.462894 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.463040 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.463195 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.463348 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.463494 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.463645 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.463814 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.464027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.464185 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.464331 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.464476 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.464628 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.464782 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.464927 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.465080 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.465224 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.465368 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.465520 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.465749 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.465907 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.466061 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.466211 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.466356 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.466510 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.466664 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.466810 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.466954 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.467106 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.467392 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.467565 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.467844 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.468070 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.468301 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.468458 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.468614 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.468804 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.468952 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.469107 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.469296 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.469447 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.469609 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.469766 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.469931 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.470121 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.470298 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.470464 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.470620 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.470776 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.470929 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.471082 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.471235 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.471390 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.471577 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.471775 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.472024 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.472223 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.472435 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.472616 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.472774 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.472774 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.473061 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.473218 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.473434 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.473636 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.473887 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.473887 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.473887 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.473887 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.474428 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.474585 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.474752 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.474899 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.475043 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.475204 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.475350 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.475514 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.475514 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.475808 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.475994 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.476183 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.476390 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.476594 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.476772 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.476928 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.477075 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.477219 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.477364 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.477523 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.477671 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.477825 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.477971 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.478134 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.478293 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.478446 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.478599 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.478757 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.478903 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.479048 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.479203 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.479459 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.479644 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.479815 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.480026 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.480230 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.480407 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.480556 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.480709 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.480856 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.481021 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.481168 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.481323 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.481478 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.481623 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.481768 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.481918 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.482077 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.482224 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.482369 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.482519 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.482673 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.482883 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.483067 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.483269 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.483425 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.483578 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.483732 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.483878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.484103 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.484265 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.484419 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.484581 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.484744 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.484890 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.485060 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.485215 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.485366 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.485518 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.485664 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.485826 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.485980 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.486127 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.486271 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.486418 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.486576 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.486731 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.486887 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.487057 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.487057 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.487343 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.487489 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.487645 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.487792 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.487792 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.488101 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.488267 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.488413 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.488569 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.488715 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.488860 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.489018 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.489173 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.489330 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.489330 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.489678 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.489833 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.489979 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.490123 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.490284 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.490431 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.490582 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.490728 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.490891 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.491047 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.491206 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.491353 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.491506 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.491661 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.491815 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.491992 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.492195 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.492366 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.492522 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.492677 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.492833 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.492997 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.493152 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.493299 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.493446 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.493601 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.493755 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.493902 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.494053 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.494197 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.494357 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.494505 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.494658 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.494820 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.494974 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.495127 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.495292 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.495440 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.495630 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.495857 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.496091 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.496247 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.496409 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.496565 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.496712 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.496875 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.497023 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.497183 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.497335 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.497489 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.497636 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.497788 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.497945 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.498111 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.498262 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.498434 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.498586 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.498732 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.498889 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.499052 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.499207 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.499354 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.499550 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.499704 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.499860 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.499860 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.499860 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.500312 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.500467 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.500614 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.500788 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.500947 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.501107 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.501261 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.501413 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.501573 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.501721 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.501721 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.502018 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.502164 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.502322 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.502474 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.502618 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.502618 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.502922 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.503074 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.503231 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.503377 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.503537 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.503682 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.503827 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.503997 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.504156 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.504310 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.504464 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.504617 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.504799 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.504956 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.505113 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.505287 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.506115 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.506282 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.506437 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.506593 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.506740 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.506740 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.507026 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.507183 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.507330 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.507501 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.507658 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.507805 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.507982 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.508139 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.508296 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.508464 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.508612 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.508757 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.508902 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.509048 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.509195 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.509371 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.509527 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.509714 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.509874 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.510022 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.510184 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.510331 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.510486 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.510683 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.510836 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.510983 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.511138 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.511342 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.511558 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.511725 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.511987 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.512187 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.512403 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.512594 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.512827 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.513028 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.513237 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.513431 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.513431 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.513816 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.513816 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.514264 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.514472 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.514648 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.514834 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.515038 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.515252 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.515448 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.515639 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.515852 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.516088 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.516295 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.516483 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.516675 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.516904 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.517108 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.517308 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.517518 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.517731 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.517940 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.518140 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.518341 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.518531 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.518685 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.518908 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.519091 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.519305 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.519516 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.519670 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.520080 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.520080 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.520486 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.520705 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.520915 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.521117 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.521319 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.521319 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.521705 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.521928 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.522127 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.522310 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.522526 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.522755 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.522944 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.523149 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.523303 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.523535 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.523768 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.523977 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.524824 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.525036 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.525232 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.525232 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.525622 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.525825 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.526032 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.526266 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.526455 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.526663 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.526870 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.527086 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.527312 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.527521 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.527696 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.527899 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.528099 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.528302 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.528543 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.528743 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.528930 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.529107 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.529316 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.529517 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.529834 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.530046 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.530265 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.530456 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.530650 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.530873 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.531069 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.531254 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.531413 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.531613 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.531795 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.532044 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.532261 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.532485 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.532669 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.532818 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.532966 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.533149 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.533334 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.533517 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.533715 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.533907 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.534107 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.534307 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.534465 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.534616 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.534770 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.534917 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.535077 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.535281 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.535488 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.535676 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.535831 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.536087 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.536246 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.536394 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.536548 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.536694 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.536848 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.537078 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.537227 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.537381 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.537544 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.537691 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.537907 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.538085 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.538234 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.538389 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.538538 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.538695 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.538842 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.539010 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.539165 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.539322 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.539476 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.539680 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.539848 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.540045 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.540193 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.540350 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.540503 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.540659 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.540814 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.540961 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.541114 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.541267 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.541422 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.541581 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.541739 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.541916 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.542075 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.542222 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.542411 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.542561 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.542797 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.542953 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.543101 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.543255 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.543408 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.543567 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.543739 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.543913 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.544077 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.544225 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.544370 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.544604 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.544769 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.544929 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.545083 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.545254 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.545433 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.545601 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.545760 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.545908 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.546061 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.546215 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.546361 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.546547 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.546728 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.546920 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.547117 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.547306 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.547546 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.547546 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.547973 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.548245 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.548462 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.548660 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.549625 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.549858 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.550105 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.550314 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.550516 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.550688 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.550883 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.551075 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.551270 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.551460 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.551686 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.551880 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.552105 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.552334 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.552517 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.552719 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.552904 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.553097 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.553302 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.553495 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.553679 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.553887 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.554086 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.554337 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.554522 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.554691 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.554867 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.555057 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.555245 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.555453 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.555644 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.555825 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.555825 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.556274 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.556457 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.556667 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.556844 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.557046 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.557231 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.557433 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.557656 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.557847 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.558048 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.558239 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.558438 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.558654 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.558856 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.559055 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.559258 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.559458 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.559631 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.560321 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.560497 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.560648 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.560803 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.561035 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.561197 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.561364 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.561518 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.561680 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.561834 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.561993 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.562153 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.562310 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.562464 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.562612 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.562758 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.562912 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.563059 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.563215 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.563376 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.563530 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.563685 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.563842 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.564022 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.564185 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.564340 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.564494 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.564647 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.564794 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.564953 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.565108 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.565261 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.565407 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.565559 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.565713 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.565884 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.566031 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.566177 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.566625 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.566775 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.566929 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.567084 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.567239 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.567392 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.567546 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.567700 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.567863 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.568102 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.568249 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.568406 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.568551 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.568696 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.568851 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.569009 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.569155 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.569300 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.569453 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.569599 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.569754 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.569900 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.570066 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.570212 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.570412 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.570563 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.570728 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.570890 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.571038 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.571038 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.571323 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.571478 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.571631 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.571631 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 16:35:30.571925 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.571925 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.571925 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.571925 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.571925 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.571925 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.571925 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.571925 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.573638 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.573638 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.573638 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.573638 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.573638 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.573638 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.573638 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.573638 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.574783 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.574783 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.574783 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.574783 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.574783 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.574783 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.574783 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.574783 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.575919 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.575919 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.575919 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.575919 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.575919 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.575919 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.575919 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.575919 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.577108 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.577108 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.577108 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.577108 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.577108 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.577108 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.577108 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.577108 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.578321 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.578321 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.578321 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.578321 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.578321 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.578321 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.578321 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.579286 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.579286 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.579286 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.579286 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.579286 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.579286 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.579286 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.580679 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.580679 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.580679 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.580679 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.580679 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.580679 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.580679 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.580679 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.581809 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.581809 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.581809 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.581809 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.581809 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.581809 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.581809 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.581809 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.582912 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.582912 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.582912 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.582912 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.582912 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.582912 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.582912 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.582912 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.584102 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.584102 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.584102 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.584102 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.584102 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.584102 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.584102 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.584102 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.585198 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.585198 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.585198 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.585198 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.585752 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.585752 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.586033 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.586340 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.586647 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.586990 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.587305 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.587619 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.587961 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.588280 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.588591 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.588897 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.589210 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.589514 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.589842 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.590151 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.590465 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.590771 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.591085 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.591391 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.591697 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.592030 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.592396 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.592714 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.593132 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.593482 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.593801 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.594123 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.594437 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.594801 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.595555 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.595555 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.595858 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.596168 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.596492 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.596812 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.597143 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.597461 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.597773 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.598128 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.598451 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.599050 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.599385 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.599708 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.600083 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.600421 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.600733 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.601046 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.601353 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.601680 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.602000 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.602312 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.602625 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.602940 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.603269 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.603557 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.603870 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.604210 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.604522 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.604835 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.605148 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.605462 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.606028 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.606216 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.606405 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.606727 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.607348 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.607348 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.607962 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.608138 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.608453 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.608882 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.609202 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.609520 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.609842 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.610177 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.610495 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.610807 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.611243 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.611565 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.611933 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.612236 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.612551 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.612877 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.613205 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.613519 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.613843 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.614572 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.614572 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.614882 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.615144 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.615473 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.615783 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.616144 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.616463 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.616779 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.617709 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.617709 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.617709 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.618186 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.618346 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.618632 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.618922 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.619230 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.619544 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.619854 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.620043 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO dbcounter [None req-1cb619dc-e989-40b9-9db7-9ca8d28f2c54 None None] Registered counter for database nova_api Sep 01 16:35:30.620217 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.620480 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.620786 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.621092 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.621407 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.621717 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.622027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.622341 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.622655 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.622958 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.623275 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.623662 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.624441 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.624441 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.624802 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.625134 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.625446 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.626102 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.626420 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.626749 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.627081 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.627485 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.627717 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.628096 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.628413 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.628782 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.629044 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.629363 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.629678 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.629994 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.630332 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.630663 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.630974 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.631311 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.631633 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.631991 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.632319 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.632634 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.632968 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.633280 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.633600 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.633907 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.634501 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.634501 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.634902 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.635130 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.635442 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.635761 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.636104 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.637474 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.637474 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.637474 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.637474 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.638177 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.638177 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.638478 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.638803 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.639280 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.639675 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.640101 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.640433 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:35:30.640677 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 16:35:30.643320 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_db.sqlalchemy.engines [None req-1cb619dc-e989-40b9-9db7-9ca8d28f2c54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:35:30.650885 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writer thread running {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:35:30.706015 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO dbcounter [None req-f6cd1e46-f174-408b-b501-616cad4c3086 None None] Registered counter for database nova_api Sep 01 16:35:30.722149 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.context [None req-1cb619dc-e989-40b9-9db7-9ca8d28f2c54 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a5e68055-5bd9-4290-838f-85cccc8a7442(cell1) {{(pid=127198) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 16:35:30.727228 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_db.sqlalchemy.engines [None req-f6cd1e46-f174-408b-b501-616cad4c3086 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:35:30.728107 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1cb619dc-e989-40b9-9db7-9ca8d28f2c54 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:30.728775 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1cb619dc-e989-40b9-9db7-9ca8d28f2c54 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:30.731239 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1cb619dc-e989-40b9-9db7-9ca8d28f2c54 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:30.732221 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1cb619dc-e989-40b9-9db7-9ca8d28f2c54 None None] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:30.732817 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1cb619dc-e989-40b9-9db7-9ca8d28f2c54 None None] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:30.734584 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writer thread running {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:35:30.735993 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1cb619dc-e989-40b9-9db7-9ca8d28f2c54 None None] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:30.738614 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO dbcounter [None req-1cb619dc-e989-40b9-9db7-9ca8d28f2c54 None None] Registered counter for database nova_cell0 Sep 01 16:35:30.743134 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO dbcounter [None req-1cb619dc-e989-40b9-9db7-9ca8d28f2c54 None None] Registered counter for database nova_cell1 Sep 01 16:35:30.752937 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_db.sqlalchemy.engines [None req-1cb619dc-e989-40b9-9db7-9ca8d28f2c54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:35:30.754499 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_db.sqlalchemy.engines [None req-1cb619dc-e989-40b9-9db7-9ca8d28f2c54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:35:30.761638 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writer thread running {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:35:30.763013 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writer thread running {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:35:30.793599 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.context [None req-f6cd1e46-f174-408b-b501-616cad4c3086 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a5e68055-5bd9-4290-838f-85cccc8a7442(cell1) {{(pid=127199) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 16:35:30.797757 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f6cd1e46-f174-408b-b501-616cad4c3086 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:30.798242 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f6cd1e46-f174-408b-b501-616cad4c3086 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:30.799812 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f6cd1e46-f174-408b-b501-616cad4c3086 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:30.800587 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f6cd1e46-f174-408b-b501-616cad4c3086 None None] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:30.801032 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f6cd1e46-f174-408b-b501-616cad4c3086 None None] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:30.803064 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f6cd1e46-f174-408b-b501-616cad4c3086 None None] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:30.805128 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO dbcounter [None req-f6cd1e46-f174-408b-b501-616cad4c3086 None None] Registered counter for database nova_cell0 Sep 01 16:35:30.809413 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO dbcounter [None req-f6cd1e46-f174-408b-b501-616cad4c3086 None None] Registered counter for database nova_cell1 Sep 01 16:35:30.817519 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_db.sqlalchemy.engines [None req-f6cd1e46-f174-408b-b501-616cad4c3086 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:35:30.818876 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_db.sqlalchemy.engines [None req-f6cd1e46-f174-408b-b501-616cad4c3086 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:35:30.825803 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writer thread running {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:35:30.827677 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writer thread running {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:35:30.914454 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO dbcounter [None req-1cb619dc-e989-40b9-9db7-9ca8d28f2c54 None None] Registered counter for database nova_cell0 Sep 01 16:35:30.921905 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_db.sqlalchemy.engines [None req-1cb619dc-e989-40b9-9db7-9ca8d28f2c54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:35:30.926692 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writer thread running {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:35:30.977874 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO dbcounter [None req-f6cd1e46-f174-408b-b501-616cad4c3086 None None] Registered counter for database nova_cell0 Sep 01 16:35:30.985123 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_db.sqlalchemy.engines [None req-f6cd1e46-f174-408b-b501-616cad4c3086 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:35:30.989964 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writer thread running {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:35:31.245539 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: WARNING keystonemiddleware.auth_token [None req-1cb619dc-e989-40b9-9db7-9ca8d28f2c54 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 16:35:31.253099 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: WARNING keystonemiddleware.auth_token [None req-1cb619dc-e989-40b9-9db7-9ca8d28f2c54 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 16:35:31.334778 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: WARNING keystonemiddleware.auth_token [None req-f6cd1e46-f174-408b-b501-616cad4c3086 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 16:35:31.344717 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: WARNING keystonemiddleware.auth_token [None req-f6cd1e46-f174-408b-b501-616cad4c3086 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 16:35:31.597477 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: WARNING keystonemiddleware.auth_token [None req-1cb619dc-e989-40b9-9db7-9ca8d28f2c54 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 16:35:31.603838 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: WARNING keystonemiddleware.auth_token [None req-1cb619dc-e989-40b9-9db7-9ca8d28f2c54 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 16:35:31.609566 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562c72f609c0 pid: 127198 (default app) Sep 01 16:35:31.710670 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: WARNING keystonemiddleware.auth_token [None req-f6cd1e46-f174-408b-b501-616cad4c3086 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 16:35:31.719100 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: WARNING keystonemiddleware.auth_token [None req-f6cd1e46-f174-408b-b501-616cad4c3086 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 16:35:31.726942 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562c72f609c0 pid: 127199 (default app) Sep 01 16:36:07.280869 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=3 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:07.281812 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=3 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:07.282864 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=3 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:07.283719 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=3 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:08.424530 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c5ad507d-8fec-4412-b694-3584c213b0d0 tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] Action: 'create', calling method: .version_select at 0x7f9483380280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-837340202"}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:08.749608 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=3 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:08.752464 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=3 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:08.753414 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=3 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:08.754183 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=3 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:10.109429 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d1bda30d-d2ca-41d3-b897-fd30e97e58a9 tempest-VolumesGetTestJSON-1883505710 tempest-VolumesGetTestJSON-1883505710-project] Action: 'create', calling method: .version_select at 0x7f9483388280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-18237774", "metadata": {"Type": "work"}}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:10.576232 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c5ad507d-8fec-4412-b694-3584c213b0d0 tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.312055 Sep 01 16:36:10.577417 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 1/1] 10.222.0.62 () {60 vars in 1155 bytes} [Thu Sep 1 16:36:07 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3315 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 01 16:36:10.594375 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-998aecd9-d379-4c8d-802a-2eb32497ad4a tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] Calling method '.version_select at 0x7f948326b160>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:11.094976 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-998aecd9-d379-4c8d-802a-2eb32497ad4a tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/55b85467-791e-4892-85cf-17c7038bbba5" status: 200 len: 344 microversion: 2.1 time: 0.505813 Sep 01 16:36:11.095563 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 2/2] 10.222.0.62 () {58 vars in 1245 bytes} [Thu Sep 1 16:36:10 2022] GET /compute/v2.1/os-volumes/55b85467-791e-4892-85cf-17c7038bbba5 => generated 344 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:36:11.655749 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d1bda30d-d2ca-41d3-b897-fd30e97e58a9 tempest-VolumesGetTestJSON-1883505710 tempest-VolumesGetTestJSON-1883505710-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 2.921059 Sep 01 16:36:11.656406 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 1/3] 10.222.0.62 () {60 vars in 1156 bytes} [Thu Sep 1 16:36:08 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 2924 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 01 16:36:11.671688 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ebdfeaac-4183-4b8b-9c1a-6e342dcd7e1c tempest-VolumesGetTestJSON-1883505710 tempest-VolumesGetTestJSON-1883505710-project] Calling method '.version_select at 0x7f948326b820>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:11.806923 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ebdfeaac-4183-4b8b-9c1a-6e342dcd7e1c tempest-VolumesGetTestJSON-1883505710 tempest-VolumesGetTestJSON-1883505710-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/112236c4-51b9-494c-ab84-a4b8d4754e97" status: 200 len: 351 microversion: 2.1 time: 0.140271 Sep 01 16:36:11.807837 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 3/4] 10.222.0.62 () {58 vars in 1245 bytes} [Thu Sep 1 16:36:11 2022] GET /compute/v2.1/os-volumes/112236c4-51b9-494c-ab84-a4b8d4754e97 => generated 351 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:36:12.115872 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-184a39d1-3f46-4028-bfdd-3f67f219b278 tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] Calling method '.version_select at 0x7f948326c160>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:12.219829 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-184a39d1-3f46-4028-bfdd-3f67f219b278 tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/55b85467-791e-4892-85cf-17c7038bbba5" status: 200 len: 345 microversion: 2.1 time: 0.109572 Sep 01 16:36:12.231018 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 2/5] 10.222.0.62 () {58 vars in 1245 bytes} [Thu Sep 1 16:36:12 2022] GET /compute/v2.1/os-volumes/55b85467-791e-4892-85cf-17c7038bbba5 => generated 345 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:36:12.234118 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-82a3bac9-49d5-47c7-9803-0eac57fba03d tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] Action: 'create', calling method: .version_select at 0x7f948326bee0>, body: {"snapshot": {"volume_id": "55b85467-791e-4892-85cf-17c7038bbba5", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1732636700"}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:12.693449 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-82a3bac9-49d5-47c7-9803-0eac57fba03d tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] 10.222.0.62 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.463311 Sep 01 16:36:12.695290 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 4/6] 10.222.0.62 () {60 vars in 1162 bytes} [Thu Sep 1 16:36:12 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:36:12.707647 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-5ed912cd-5c63-495d-b98b-48603973a323 tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] Calling method '.version_select at 0x7f948326c8b0>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:12.778697 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-5ed912cd-5c63-495d-b98b-48603973a323 tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/c2111bfd-da34-4e1a-92bf-88858a4f45d3" status: 200 len: 287 microversion: 2.1 time: 0.076243 Sep 01 16:36:12.784936 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 3/7] 10.222.0.62 () {58 vars in 1251 bytes} [Thu Sep 1 16:36:12 2022] GET /compute/v2.1/os-snapshots/c2111bfd-da34-4e1a-92bf-88858a4f45d3 => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:36:12.795093 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-fd356d9f-cdf2-4025-9773-79f5ab522b3f tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] Calling method '.version_select at 0x7f948326bca0>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:12.821204 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-bec658fa-be94-454d-b9f2-971f1279042c tempest-VolumesGetTestJSON-1883505710 tempest-VolumesGetTestJSON-1883505710-project] Calling method '.version_select at 0x7f94831f4040>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:12.913727 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-fd356d9f-cdf2-4025-9773-79f5ab522b3f tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.126546 Sep 01 16:36:12.914395 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 5/8] 10.222.0.62 () {58 vars in 1140 bytes} [Thu Sep 1 16:36:12 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:36:12.925795 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b681ac45-7d2e-4a37-b9b8-738058539763 tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] Calling method '.version_select at 0x7f94831f2af0>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:12.984674 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b681ac45-7d2e-4a37-b9b8-738058539763 tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/c2111bfd-da34-4e1a-92bf-88858a4f45d3" status: 200 len: 287 microversion: 2.1 time: 0.063348 Sep 01 16:36:12.985675 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 6/9] 10.222.0.62 () {58 vars in 1251 bytes} [Thu Sep 1 16:36:12 2022] GET /compute/v2.1/os-snapshots/c2111bfd-da34-4e1a-92bf-88858a4f45d3 => generated 287 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:36:13.002889 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-bec658fa-be94-454d-b9f2-971f1279042c tempest-VolumesGetTestJSON-1883505710 tempest-VolumesGetTestJSON-1883505710-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/112236c4-51b9-494c-ab84-a4b8d4754e97" status: 200 len: 352 microversion: 2.1 time: 0.185446 Sep 01 16:36:13.003463 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 4/10] 10.222.0.62 () {58 vars in 1245 bytes} [Thu Sep 1 16:36:12 2022] GET /compute/v2.1/os-volumes/112236c4-51b9-494c-ab84-a4b8d4754e97 => generated 352 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:36:13.016117 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1f62fc5b-31d0-4c27-b9de-ff291bcc48e9 tempest-VolumesGetTestJSON-1883505710 tempest-VolumesGetTestJSON-1883505710-project] Calling method '.version_select at 0x7f94831f2310>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:13.085669 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1f62fc5b-31d0-4c27-b9de-ff291bcc48e9 tempest-VolumesGetTestJSON-1883505710 tempest-VolumesGetTestJSON-1883505710-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/112236c4-51b9-494c-ab84-a4b8d4754e97" status: 200 len: 352 microversion: 2.1 time: 0.073584 Sep 01 16:36:13.100258 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-99485cc0-8979-47c3-8163-946ed18d7943 tempest-VolumesGetTestJSON-1883505710 tempest-VolumesGetTestJSON-1883505710-project] Calling method '.version_select at 0x7f948326cb80>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:13.100519 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 7/11] 10.222.0.62 () {58 vars in 1245 bytes} [Thu Sep 1 16:36:13 2022] GET /compute/v2.1/os-volumes/112236c4-51b9-494c-ab84-a4b8d4754e97 => generated 352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:36:13.262979 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-99485cc0-8979-47c3-8163-946ed18d7943 tempest-VolumesGetTestJSON-1883505710 tempest-VolumesGetTestJSON-1883505710-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/112236c4-51b9-494c-ab84-a4b8d4754e97" status: 202 len: 0 microversion: 2.1 time: 0.166810 Sep 01 16:36:13.264042 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 5/12] 10.222.0.62 () {58 vars in 1248 bytes} [Thu Sep 1 16:36:13 2022] DELETE /compute/v2.1/os-volumes/112236c4-51b9-494c-ab84-a4b8d4754e97 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:36:13.271946 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c754334b-1431-4844-a56f-28d925ec8dd6 tempest-VolumesGetTestJSON-1883505710 tempest-VolumesGetTestJSON-1883505710-project] Calling method '.version_select at 0x7f94831f2dc0>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:13.353754 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c754334b-1431-4844-a56f-28d925ec8dd6 tempest-VolumesGetTestJSON-1883505710 tempest-VolumesGetTestJSON-1883505710-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/112236c4-51b9-494c-ab84-a4b8d4754e97" status: 200 len: 351 microversion: 2.1 time: 0.085447 Sep 01 16:36:13.354342 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 8/13] 10.222.0.62 () {58 vars in 1245 bytes} [Thu Sep 1 16:36:13 2022] GET /compute/v2.1/os-volumes/112236c4-51b9-494c-ab84-a4b8d4754e97 => generated 351 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:36:13.998254 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-dfa185af-cc1c-4148-af25-6f58eb568488 tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] Calling method '.version_select at 0x7f948326c430>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:14.154839 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-dfa185af-cc1c-4148-af25-6f58eb568488 tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/c2111bfd-da34-4e1a-92bf-88858a4f45d3" status: 200 len: 287 microversion: 2.1 time: 0.160202 Sep 01 16:36:14.155421 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 6/14] 10.222.0.62 () {58 vars in 1251 bytes} [Thu Sep 1 16:36:13 2022] GET /compute/v2.1/os-snapshots/c2111bfd-da34-4e1a-92bf-88858a4f45d3 => generated 287 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:36:14.368430 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-083b2e69-94d6-4cc0-9bf1-e46025e9dd07 tempest-VolumesGetTestJSON-1883505710 tempest-VolumesGetTestJSON-1883505710-project] Calling method '.version_select at 0x7f94831f2700>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:14.437877 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-083b2e69-94d6-4cc0-9bf1-e46025e9dd07 tempest-VolumesGetTestJSON-1883505710 tempest-VolumesGetTestJSON-1883505710-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/112236c4-51b9-494c-ab84-a4b8d4754e97" status: 200 len: 351 microversion: 2.1 time: 0.074070 Sep 01 16:36:14.438845 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 9/15] 10.222.0.62 () {58 vars in 1245 bytes} [Thu Sep 1 16:36:14 2022] GET /compute/v2.1/os-volumes/112236c4-51b9-494c-ab84-a4b8d4754e97 => generated 351 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:36:15.168601 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-20d32925-3679-4dd5-b320-79360be118b8 tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] Calling method '.version_select at 0x7f94831f43a0>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:15.226215 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-20d32925-3679-4dd5-b320-79360be118b8 tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/c2111bfd-da34-4e1a-92bf-88858a4f45d3" status: 200 len: 287 microversion: 2.1 time: 0.063144 Sep 01 16:36:15.227222 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 7/16] 10.222.0.62 () {58 vars in 1251 bytes} [Thu Sep 1 16:36:15 2022] GET /compute/v2.1/os-snapshots/c2111bfd-da34-4e1a-92bf-88858a4f45d3 => generated 287 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:36:15.455045 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a45d3c52-00cd-4f8f-a9bc-7c07668575e6 tempest-VolumesGetTestJSON-1883505710 tempest-VolumesGetTestJSON-1883505710-project] Calling method '.version_select at 0x7f948326b040>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:15.605350 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a45d3c52-00cd-4f8f-a9bc-7c07668575e6 tempest-VolumesGetTestJSON-1883505710 tempest-VolumesGetTestJSON-1883505710-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/112236c4-51b9-494c-ab84-a4b8d4754e97" status: 200 len: 351 microversion: 2.1 time: 0.157155 Sep 01 16:36:15.608319 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 10/17] 10.222.0.62 () {58 vars in 1245 bytes} [Thu Sep 1 16:36:15 2022] GET /compute/v2.1/os-volumes/112236c4-51b9-494c-ab84-a4b8d4754e97 => generated 351 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:36:16.238875 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-3e28654b-5be1-4211-b9e6-f0874b4a2764 tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] Calling method '.version_select at 0x7f948326c3a0>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:16.294279 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-3e28654b-5be1-4211-b9e6-f0874b4a2764 tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/c2111bfd-da34-4e1a-92bf-88858a4f45d3" status: 200 len: 288 microversion: 2.1 time: 0.059165 Sep 01 16:36:16.295812 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 8/18] 10.222.0.62 () {58 vars in 1251 bytes} [Thu Sep 1 16:36:16 2022] GET /compute/v2.1/os-snapshots/c2111bfd-da34-4e1a-92bf-88858a4f45d3 => generated 288 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:36:16.306442 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-179c4aec-beae-4a30-a1ed-386ce6ffef5b tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] Calling method '.version_select at 0x7f948326b700>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:16.486577 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-179c4aec-beae-4a30-a1ed-386ce6ffef5b tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] 10.222.0.62 "DELETE /compute/v2.1/os-snapshots/c2111bfd-da34-4e1a-92bf-88858a4f45d3" status: 202 len: 0 microversion: 2.1 time: 0.184172 Sep 01 16:36:16.487203 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 11/19] 10.222.0.62 () {58 vars in 1254 bytes} [Thu Sep 1 16:36:16 2022] DELETE /compute/v2.1/os-snapshots/c2111bfd-da34-4e1a-92bf-88858a4f45d3 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:36:16.496292 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-5317a92b-d53c-443b-a45a-9c599c2e980b tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] Calling method '.version_select at 0x7f948326caf0>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:16.574720 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-5317a92b-d53c-443b-a45a-9c599c2e980b tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/c2111bfd-da34-4e1a-92bf-88858a4f45d3" status: 200 len: 287 microversion: 2.1 time: 0.082872 Sep 01 16:36:16.575703 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 9/20] 10.222.0.62 () {58 vars in 1251 bytes} [Thu Sep 1 16:36:16 2022] GET /compute/v2.1/os-snapshots/c2111bfd-da34-4e1a-92bf-88858a4f45d3 => generated 287 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:36:16.623756 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d23b002a-328f-4460-a213-39245bd0daf2 tempest-VolumesGetTestJSON-1883505710 tempest-VolumesGetTestJSON-1883505710-project] Calling method '.version_select at 0x7f94831f20d0>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:16.685374 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-d23b002a-328f-4460-a213-39245bd0daf2 tempest-VolumesGetTestJSON-1883505710 tempest-VolumesGetTestJSON-1883505710-project] HTTP exception thrown: Volume 112236c4-51b9-494c-ab84-a4b8d4754e97 could not be found. Sep 01 16:36:16.690947 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d23b002a-328f-4460-a213-39245bd0daf2 tempest-VolumesGetTestJSON-1883505710 tempest-VolumesGetTestJSON-1883505710-project] Request method failure captured: Sep 01 16:36:16.690947 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/os-volumes/112236c4-51b9-494c-ab84-a4b8d4754e97 HTTP/1.1 Sep 01 16:36:16.690947 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 01 16:36:16.690947 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 01 16:36:16.690947 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Connection: close Sep 01 16:36:16.690947 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 01 16:36:16.690947 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 01 16:36:16.690947 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Host: 10.222.0.62 Sep 01 16:36:16.690947 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 01 16:36:16.690947 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 01 16:36:16.690947 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjEN944od_o37m-PcJ_s27EwIee4wSQtFJOs4Ri9_d_xB-OKYYcaq8ey7ObJ3W9n1Cc5AbmFebE1tU3bTT4kXnYRteuZ5Z8aTfVZravoHadHmhrtLtcJ8iS5lehtA8ucHs2yprcp-ZV1_dmi4iEQDsDKxCgyyT_itKsf72-bWBIXFnHWo Sep 01 16:36:16.690947 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 01 16:36:16.690947 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 01 16:36:16.690947 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 01 16:36:16.690947 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 01 16:36:16.690947 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 01 16:36:16.690947 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 01 16:36:16.690947 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Id: b7ebaf9d1f494b7ab9f5adde08010a4d Sep 01 16:36:16.690947 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-VolumesGetTestJSON-1883505710 Sep 01 16:36:16.690947 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 01 16:36:16.690947 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 01 16:36:16.692067 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b7ebaf9d1f494b7ab9f5adde08010a4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b7ebaf9d1f494b7ab9f5adde08010a4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b7ebaf9d1f494b7ab9f5adde08010a4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b7ebaf9d1f494b7ab9f5adde08010a4d"}]}] Sep 01 16:36:16.692067 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-VolumesGetTestJSON-1883505710 Sep 01 16:36:16.692067 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Id: b7ebaf9d1f494b7ab9f5adde08010a4d Sep 01 16:36:16.692067 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-VolumesGetTestJSON-1883505710 Sep 01 16:36:16.692067 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User: tempest-VolumesGetTestJSON-1883505710-project Sep 01 16:36:16.692067 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 01 16:36:16.692067 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 01 16:36:16.692067 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Id: 33d52af42954466e991986fd550e9270 Sep 01 16:36:16.692067 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-VolumesGetTestJSON-1883505710-project Sep 01 16:36:16.692067 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: method: Sep 01 16:36:16.692067 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: exception: Volume 112236c4-51b9-494c-ab84-a4b8d4754e97 could not be found. Sep 01 16:36:16.692067 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: action_args: {'id': '112236c4-51b9-494c-ab84-a4b8d4754e97'} Sep 01 16:36:16.692067 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:36:16.692844 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:36:16.692844 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:36:16.692844 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:36:16.692844 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 16:36:16.692844 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 16:36:16.692844 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 16:36:16.692844 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 16:36:16.692844 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 16:36:16.692844 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 16:36:16.692844 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 16:36:16.692844 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 16:36:16.692844 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:36:16.692844 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:36:16.692844 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:36:16.692844 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:36:16.692844 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 112236c4-51b9-494c-ab84-a4b8d4754e97 could not be found. (HTTP 404) (Request-ID: req-99a1453f-7c89-48c5-9ecf-8b2a82106ec1) Sep 01 16:36:16.692844 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:36:16.692844 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:36:16.692844 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:36:16.693818 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:36:16.693818 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 16:36:16.693818 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 16:36:16.693818 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 16:36:16.693818 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 16:36:16.693818 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 16:36:16.693818 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 16:36:16.693818 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 16:36:16.693818 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 16:36:16.693818 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:36:16.693818 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:36:16.693818 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 16:36:16.693818 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 16:36:16.693818 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 16:36:16.693818 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 16:36:16.693818 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 16:36:16.693818 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 16:36:16.693818 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 16:36:16.693818 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 16:36:16.694693 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:36:16.694693 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:36:16.694693 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:36:16.694693 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:36:16.694693 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 112236c4-51b9-494c-ab84-a4b8d4754e97 could not be found. Sep 01 16:36:16.694693 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:36:16.694693 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:36:16.694693 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:36:16.694693 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:36:16.694693 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:36:16.694693 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:36:16.694693 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:36:16.694693 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:36:16.694693 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 16:36:16.694693 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 16:36:16.694693 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:36:16.694693 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:36:16.694693 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 16:36:16.694693 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:36:16.696940 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 112236c4-51b9-494c-ab84-a4b8d4754e97 could not be found. Sep 01 16:36:16.696940 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:36:16.696940 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:36:16.696940 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:36:16.696940 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:36:16.696940 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:36:16.696940 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:36:16.696940 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:36:16.696940 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:36:16.696940 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 112236c4-51b9-494c-ab84-a4b8d4754e97 could not be found. Sep 01 16:36:16.696940 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:36:16.696940 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d23b002a-328f-4460-a213-39245bd0daf2 tempest-VolumesGetTestJSON-1883505710 tempest-VolumesGetTestJSON-1883505710-project] Returning 404 to user: Volume 112236c4-51b9-494c-ab84-a4b8d4754e97 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:36:16.696940 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d23b002a-328f-4460-a213-39245bd0daf2 tempest-VolumesGetTestJSON-1883505710 tempest-VolumesGetTestJSON-1883505710-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/112236c4-51b9-494c-ab84-a4b8d4754e97" status: 404 len: 109 microversion: 2.1 time: 0.077243 Sep 01 16:36:16.699698 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 12/21] 10.222.0.62 () {58 vars in 1245 bytes} [Thu Sep 1 16:36:16 2022] GET /compute/v2.1/os-volumes/112236c4-51b9-494c-ab84-a4b8d4754e97 => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:36:17.591741 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-187f8945-a617-412b-a0e7-3f2d46364a60 tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] Calling method '.version_select at 0x7f9483388280>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:17.654843 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-187f8945-a617-412b-a0e7-3f2d46364a60 tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] HTTP exception thrown: Snapshot c2111bfd-da34-4e1a-92bf-88858a4f45d3 could not be found. Sep 01 16:36:17.665112 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-187f8945-a617-412b-a0e7-3f2d46364a60 tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] Request method failure captured: Sep 01 16:36:17.665112 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: request: GET /compute/v2.1/os-snapshots/c2111bfd-da34-4e1a-92bf-88858a4f45d3 HTTP/1.1 Sep 01 16:36:17.665112 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 01 16:36:17.665112 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 01 16:36:17.665112 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Connection: close Sep 01 16:36:17.665112 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 01 16:36:17.665112 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 01 16:36:17.665112 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Host: 10.222.0.62 Sep 01 16:36:17.665112 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 01 16:36:17.665112 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 01 16:36:17.665112 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjEN93cGrvcbzPuDuBhv3pSQXRQWvMO2WByui-cCqe2LhsDr_YjbASSZWGAnuTihP-KQNLF_mz48_-FbpTffYb2nkcuh9dAjlM1PXSRVKdbzS5kpT_Y3Wmkka5-x0ZaD8N3daGy_EYwJtYY9g49zsvBTDIeg--meJrzKWhpi6K-EtXq0M Sep 01 16:36:17.665112 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 01 16:36:17.665112 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 01 16:36:17.665112 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 01 16:36:17.665112 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 01 16:36:17.665112 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 01 16:36:17.665112 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 01 16:36:17.665112 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Id: 276464f90d71465097dae2fe81bdf031 Sep 01 16:36:17.665112 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-314566135 Sep 01 16:36:17.665112 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 01 16:36:17.665112 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 01 16:36:17.666455 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/276464f90d71465097dae2fe81bdf031"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/276464f90d71465097dae2fe81bdf031"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_276464f90d71465097dae2fe81bdf031"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/276464f90d71465097dae2fe81bdf031"}]}] Sep 01 16:36:17.666455 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-VolumesSnapshotsTestJSON-314566135 Sep 01 16:36:17.666455 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Id: 276464f90d71465097dae2fe81bdf031 Sep 01 16:36:17.666455 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-314566135 Sep 01 16:36:17.666455 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User: tempest-VolumesSnapshotsTestJSON-314566135-project Sep 01 16:36:17.666455 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 01 16:36:17.666455 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 01 16:36:17.666455 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Id: f1c0a7b17511415ea9316dc8e61dc8c9 Sep 01 16:36:17.666455 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-VolumesSnapshotsTestJSON-314566135-project Sep 01 16:36:17.666455 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: method: Sep 01 16:36:17.666455 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: exception: Snapshot c2111bfd-da34-4e1a-92bf-88858a4f45d3 could not be found. Sep 01 16:36:17.666455 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: action_args: {'id': 'c2111bfd-da34-4e1a-92bf-88858a4f45d3'} Sep 01 16:36:17.666455 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:36:17.667109 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:36:17.667109 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 01 16:36:17.667109 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 01 16:36:17.667109 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 01 16:36:17.667109 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 01 16:36:17.667109 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 01 16:36:17.667109 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 01 16:36:17.667109 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 16:36:17.667109 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 16:36:17.667109 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 16:36:17.667109 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 16:36:17.667109 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:36:17.667109 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:36:17.667109 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:36:17.667109 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:36:17.667109 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c2111bfd-da34-4e1a-92bf-88858a4f45d3 could not be found. (HTTP 404) (Request-ID: req-ccf7d8ec-a8c4-46dc-9fdb-131d092e5588) Sep 01 16:36:17.667109 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:36:17.667109 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:36:17.668027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:36:17.668027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:36:17.668027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 01 16:36:17.668027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 01 16:36:17.668027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 16:36:17.668027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 16:36:17.668027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 01 16:36:17.668027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 01 16:36:17.668027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 16:36:17.668027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 16:36:17.668027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 01 16:36:17.668027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 01 16:36:17.668027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 01 16:36:17.668027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 01 16:36:17.668027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 01 16:36:17.668027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 01 16:36:17.668027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 16:36:17.668027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 16:36:17.668027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 16:36:17.669084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 16:36:17.669084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:36:17.669084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:36:17.669084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:36:17.669084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:36:17.669084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c2111bfd-da34-4e1a-92bf-88858a4f45d3 could not be found. Sep 01 16:36:17.669084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:36:17.669084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:36:17.669084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:36:17.669084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:36:17.669084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:36:17.669084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:36:17.669084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:36:17.669084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:36:17.669084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 16:36:17.669084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 16:36:17.669084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:36:17.669084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:36:17.669084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 01 16:36:17.669084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:36:17.670393 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c2111bfd-da34-4e1a-92bf-88858a4f45d3 could not be found. Sep 01 16:36:17.670393 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:36:17.670393 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:36:17.670393 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:36:17.670393 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:36:17.670393 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:36:17.670393 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:36:17.670393 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:36:17.670393 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:36:17.670393 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c2111bfd-da34-4e1a-92bf-88858a4f45d3 could not be found. Sep 01 16:36:17.670393 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:36:17.670393 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-187f8945-a617-412b-a0e7-3f2d46364a60 tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] Returning 404 to user: Snapshot c2111bfd-da34-4e1a-92bf-88858a4f45d3 could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:36:17.670393 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-187f8945-a617-412b-a0e7-3f2d46364a60 tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/c2111bfd-da34-4e1a-92bf-88858a4f45d3" status: 404 len: 111 microversion: 2.1 time: 0.080863 Sep 01 16:36:17.670393 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 10/22] 10.222.0.62 () {58 vars in 1251 bytes} [Thu Sep 1 16:36:17 2022] GET /compute/v2.1/os-snapshots/c2111bfd-da34-4e1a-92bf-88858a4f45d3 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:36:17.678379 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5e243ce8-0cbc-4712-9d56-3e3811309d25 tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] Calling method '.version_select at 0x7f9483bc6700>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:17.857308 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5e243ce8-0cbc-4712-9d56-3e3811309d25 tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/55b85467-791e-4892-85cf-17c7038bbba5" status: 202 len: 0 microversion: 2.1 time: 0.184744 Sep 01 16:36:17.860766 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 13/23] 10.222.0.62 () {58 vars in 1248 bytes} [Thu Sep 1 16:36:17 2022] DELETE /compute/v2.1/os-volumes/55b85467-791e-4892-85cf-17c7038bbba5 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:36:17.868805 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7683e3c2-011f-4be4-9b0f-6c52ef8c4ad7 tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] Calling method '.version_select at 0x7f94831f4a60>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:18.018435 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-7683e3c2-011f-4be4-9b0f-6c52ef8c4ad7 tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/55b85467-791e-4892-85cf-17c7038bbba5" status: 200 len: 344 microversion: 2.1 time: 0.155744 Sep 01 16:36:18.019783 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 11/24] 10.222.0.62 () {58 vars in 1245 bytes} [Thu Sep 1 16:36:17 2022] GET /compute/v2.1/os-volumes/55b85467-791e-4892-85cf-17c7038bbba5 => generated 344 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:36:19.034114 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c4fb9f9a-da63-48f6-a286-0d6159d46c02 tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] Calling method '.version_select at 0x7f94831f2af0>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:19.093375 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-c4fb9f9a-da63-48f6-a286-0d6159d46c02 tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] HTTP exception thrown: Volume 55b85467-791e-4892-85cf-17c7038bbba5 could not be found. Sep 01 16:36:19.096199 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c4fb9f9a-da63-48f6-a286-0d6159d46c02 tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] Request method failure captured: Sep 01 16:36:19.096199 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/os-volumes/55b85467-791e-4892-85cf-17c7038bbba5 HTTP/1.1 Sep 01 16:36:19.096199 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 01 16:36:19.096199 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 01 16:36:19.096199 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Connection: close Sep 01 16:36:19.096199 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 01 16:36:19.096199 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 01 16:36:19.096199 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Host: 10.222.0.62 Sep 01 16:36:19.096199 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 01 16:36:19.096199 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 01 16:36:19.096199 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjEN93cGrvcbzPuDuBhv3pSQXRQWvMO2WByui-cCqe2LhsDr_YjbASSZWGAnuTihP-KQNLF_mz48_-FbpTffYb2nkcuh9dAjlM1PXSRVKdbzS5kpT_Y3Wmkka5-x0ZaD8N3daGy_EYwJtYY9g49zsvBTDIeg--meJrzKWhpi6K-EtXq0M Sep 01 16:36:19.096199 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 01 16:36:19.096199 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 01 16:36:19.096199 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 01 16:36:19.096199 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 01 16:36:19.096199 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 01 16:36:19.096199 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 01 16:36:19.096199 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Id: 276464f90d71465097dae2fe81bdf031 Sep 01 16:36:19.096199 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-314566135 Sep 01 16:36:19.096199 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 01 16:36:19.096199 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 01 16:36:19.097271 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/276464f90d71465097dae2fe81bdf031"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/276464f90d71465097dae2fe81bdf031"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_276464f90d71465097dae2fe81bdf031"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/276464f90d71465097dae2fe81bdf031"}]}] Sep 01 16:36:19.097271 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-VolumesSnapshotsTestJSON-314566135 Sep 01 16:36:19.097271 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Id: 276464f90d71465097dae2fe81bdf031 Sep 01 16:36:19.097271 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-314566135 Sep 01 16:36:19.097271 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User: tempest-VolumesSnapshotsTestJSON-314566135-project Sep 01 16:36:19.097271 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 01 16:36:19.097271 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 01 16:36:19.097271 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Id: f1c0a7b17511415ea9316dc8e61dc8c9 Sep 01 16:36:19.097271 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-VolumesSnapshotsTestJSON-314566135-project Sep 01 16:36:19.097271 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: method: Sep 01 16:36:19.097271 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: exception: Volume 55b85467-791e-4892-85cf-17c7038bbba5 could not be found. Sep 01 16:36:19.097271 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: action_args: {'id': '55b85467-791e-4892-85cf-17c7038bbba5'} Sep 01 16:36:19.097271 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:36:19.097942 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:36:19.097942 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:36:19.097942 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:36:19.097942 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 16:36:19.097942 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 16:36:19.097942 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 16:36:19.097942 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 16:36:19.097942 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 16:36:19.097942 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 16:36:19.097942 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 16:36:19.097942 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 16:36:19.097942 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:36:19.097942 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:36:19.097942 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:36:19.097942 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:36:19.097942 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 55b85467-791e-4892-85cf-17c7038bbba5 could not be found. (HTTP 404) (Request-ID: req-71b89b6d-b4f4-4678-a5f6-4055a0280399) Sep 01 16:36:19.097942 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:36:19.097942 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:36:19.097942 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:36:19.098801 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:36:19.098801 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 16:36:19.098801 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 16:36:19.098801 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 16:36:19.098801 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 16:36:19.098801 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 16:36:19.098801 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 16:36:19.098801 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 16:36:19.098801 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 16:36:19.098801 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:36:19.098801 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:36:19.098801 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 16:36:19.098801 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 16:36:19.098801 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 16:36:19.098801 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 16:36:19.098801 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 16:36:19.098801 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 16:36:19.098801 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 16:36:19.098801 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 16:36:19.099665 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:36:19.099665 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:36:19.099665 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:36:19.099665 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:36:19.099665 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 55b85467-791e-4892-85cf-17c7038bbba5 could not be found. Sep 01 16:36:19.099665 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:36:19.099665 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:36:19.099665 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:36:19.099665 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:36:19.099665 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:36:19.099665 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:36:19.099665 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:36:19.099665 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:36:19.099665 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 16:36:19.099665 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 16:36:19.099665 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:36:19.099665 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:36:19.099665 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 16:36:19.099665 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:36:19.100537 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 55b85467-791e-4892-85cf-17c7038bbba5 could not be found. Sep 01 16:36:19.100537 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:36:19.100537 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:36:19.100537 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:36:19.100537 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:36:19.100537 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:36:19.100537 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:36:19.100537 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:36:19.100537 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:36:19.100537 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 55b85467-791e-4892-85cf-17c7038bbba5 could not be found. Sep 01 16:36:19.100537 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:36:19.103665 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c4fb9f9a-da63-48f6-a286-0d6159d46c02 tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] Returning 404 to user: Volume 55b85467-791e-4892-85cf-17c7038bbba5 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:36:19.105000 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c4fb9f9a-da63-48f6-a286-0d6159d46c02 tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/55b85467-791e-4892-85cf-17c7038bbba5" status: 404 len: 109 microversion: 2.1 time: 0.075413 Sep 01 16:36:19.105777 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 14/25] 10.222.0.62 () {58 vars in 1245 bytes} [Thu Sep 1 16:36:19 2022] GET /compute/v2.1/os-volumes/55b85467-791e-4892-85cf-17c7038bbba5 => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:36:19.123236 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8c51e5e6-c202-4d6d-aaae-269bb819f6f2 tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] Calling method '.version_select at 0x7f94831d9160>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:19.173260 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-8c51e5e6-c202-4d6d-aaae-269bb819f6f2 tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] HTTP exception thrown: Volume 55b85467-791e-4892-85cf-17c7038bbba5 could not be found. Sep 01 16:36:19.175736 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8c51e5e6-c202-4d6d-aaae-269bb819f6f2 tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] Request method failure captured: Sep 01 16:36:19.175736 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: request: DELETE /compute/v2.1/os-volumes/55b85467-791e-4892-85cf-17c7038bbba5 HTTP/1.1 Sep 01 16:36:19.175736 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 01 16:36:19.175736 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 01 16:36:19.175736 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Connection: close Sep 01 16:36:19.175736 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 01 16:36:19.175736 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 01 16:36:19.175736 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Host: 10.222.0.62 Sep 01 16:36:19.175736 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 01 16:36:19.175736 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 01 16:36:19.175736 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjEN93cGrvcbzPuDuBhv3pSQXRQWvMO2WByui-cCqe2LhsDr_YjbASSZWGAnuTihP-KQNLF_mz48_-FbpTffYb2nkcuh9dAjlM1PXSRVKdbzS5kpT_Y3Wmkka5-x0ZaD8N3daGy_EYwJtYY9g49zsvBTDIeg--meJrzKWhpi6K-EtXq0M Sep 01 16:36:19.175736 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 01 16:36:19.175736 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 01 16:36:19.175736 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 01 16:36:19.175736 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 01 16:36:19.175736 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 01 16:36:19.175736 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 01 16:36:19.175736 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Id: 276464f90d71465097dae2fe81bdf031 Sep 01 16:36:19.175736 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-314566135 Sep 01 16:36:19.175736 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 01 16:36:19.175736 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 01 16:36:19.176966 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/276464f90d71465097dae2fe81bdf031"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/276464f90d71465097dae2fe81bdf031"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_276464f90d71465097dae2fe81bdf031"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/276464f90d71465097dae2fe81bdf031"}]}] Sep 01 16:36:19.176966 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-VolumesSnapshotsTestJSON-314566135 Sep 01 16:36:19.176966 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Id: 276464f90d71465097dae2fe81bdf031 Sep 01 16:36:19.176966 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-314566135 Sep 01 16:36:19.176966 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User: tempest-VolumesSnapshotsTestJSON-314566135-project Sep 01 16:36:19.176966 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 01 16:36:19.176966 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 01 16:36:19.176966 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Id: f1c0a7b17511415ea9316dc8e61dc8c9 Sep 01 16:36:19.176966 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-VolumesSnapshotsTestJSON-314566135-project Sep 01 16:36:19.176966 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: method: Sep 01 16:36:19.176966 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: exception: Volume 55b85467-791e-4892-85cf-17c7038bbba5 could not be found. Sep 01 16:36:19.176966 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: action_args: {'id': '55b85467-791e-4892-85cf-17c7038bbba5'} Sep 01 16:36:19.176966 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:36:19.177740 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:36:19.177740 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:36:19.177740 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:36:19.177740 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 16:36:19.177740 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 16:36:19.177740 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 16:36:19.177740 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 16:36:19.177740 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 16:36:19.177740 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 16:36:19.177740 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 16:36:19.177740 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 16:36:19.177740 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:36:19.177740 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:36:19.177740 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:36:19.177740 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:36:19.177740 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 55b85467-791e-4892-85cf-17c7038bbba5 could not be found. (HTTP 404) (Request-ID: req-157e570c-04e5-4c05-aedd-be0d685e2747) Sep 01 16:36:19.177740 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:36:19.177740 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:36:19.177740 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:36:19.178862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:36:19.178862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 16:36:19.178862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 16:36:19.178862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 16:36:19.178862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 16:36:19.178862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 16:36:19.178862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 16:36:19.178862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 16:36:19.178862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 16:36:19.178862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:36:19.178862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:36:19.178862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 16:36:19.178862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 16:36:19.178862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 16:36:19.178862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 16:36:19.178862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 16:36:19.178862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 16:36:19.178862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 16:36:19.178862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 16:36:19.180081 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:36:19.180081 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:36:19.180081 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:36:19.180081 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:36:19.180081 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 55b85467-791e-4892-85cf-17c7038bbba5 could not be found. Sep 01 16:36:19.180081 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:36:19.180081 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:36:19.180081 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:36:19.180081 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:36:19.180081 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:36:19.180081 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:36:19.180081 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:36:19.180081 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:36:19.180081 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 16:36:19.180081 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 16:36:19.180081 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:36:19.180081 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:36:19.180081 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 16:36:19.180081 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:36:19.181152 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 55b85467-791e-4892-85cf-17c7038bbba5 could not be found. Sep 01 16:36:19.181152 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:36:19.181152 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:36:19.181152 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:36:19.181152 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:36:19.181152 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:36:19.181152 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:36:19.181152 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:36:19.181152 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:36:19.181152 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 55b85467-791e-4892-85cf-17c7038bbba5 could not be found. Sep 01 16:36:19.181152 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:36:19.183045 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8c51e5e6-c202-4d6d-aaae-269bb819f6f2 tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] Returning 404 to user: Volume 55b85467-791e-4892-85cf-17c7038bbba5 could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:36:19.184082 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8c51e5e6-c202-4d6d-aaae-269bb819f6f2 tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/55b85467-791e-4892-85cf-17c7038bbba5" status: 404 len: 109 microversion: 2.1 time: 0.065126 Sep 01 16:36:19.194745 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3a24f286-781d-4243-967c-4c99c49682be tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] Calling method '.version_select at 0x7f94831de790>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:19.200175 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 12/26] 10.222.0.62 () {58 vars in 1248 bytes} [Thu Sep 1 16:36:19 2022] DELETE /compute/v2.1/os-volumes/55b85467-791e-4892-85cf-17c7038bbba5 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:36:19.229618 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-3a24f286-781d-4243-967c-4c99c49682be tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] HTTP exception thrown: Volume 55b85467-791e-4892-85cf-17c7038bbba5 could not be found. Sep 01 16:36:19.231745 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3a24f286-781d-4243-967c-4c99c49682be tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] Request method failure captured: Sep 01 16:36:19.231745 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/os-volumes/55b85467-791e-4892-85cf-17c7038bbba5 HTTP/1.1 Sep 01 16:36:19.231745 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 01 16:36:19.231745 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 01 16:36:19.231745 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Connection: close Sep 01 16:36:19.231745 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 01 16:36:19.231745 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 01 16:36:19.231745 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Host: 10.222.0.62 Sep 01 16:36:19.231745 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 01 16:36:19.231745 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 01 16:36:19.231745 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjEN93cGrvcbzPuDuBhv3pSQXRQWvMO2WByui-cCqe2LhsDr_YjbASSZWGAnuTihP-KQNLF_mz48_-FbpTffYb2nkcuh9dAjlM1PXSRVKdbzS5kpT_Y3Wmkka5-x0ZaD8N3daGy_EYwJtYY9g49zsvBTDIeg--meJrzKWhpi6K-EtXq0M Sep 01 16:36:19.231745 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 01 16:36:19.231745 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 01 16:36:19.231745 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 01 16:36:19.231745 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 01 16:36:19.231745 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 01 16:36:19.231745 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 01 16:36:19.231745 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Id: 276464f90d71465097dae2fe81bdf031 Sep 01 16:36:19.231745 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-314566135 Sep 01 16:36:19.231745 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 01 16:36:19.231745 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 01 16:36:19.233011 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/276464f90d71465097dae2fe81bdf031"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/276464f90d71465097dae2fe81bdf031"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_276464f90d71465097dae2fe81bdf031"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/276464f90d71465097dae2fe81bdf031"}]}] Sep 01 16:36:19.233011 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-VolumesSnapshotsTestJSON-314566135 Sep 01 16:36:19.233011 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Id: 276464f90d71465097dae2fe81bdf031 Sep 01 16:36:19.233011 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-314566135 Sep 01 16:36:19.233011 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User: tempest-VolumesSnapshotsTestJSON-314566135-project Sep 01 16:36:19.233011 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 01 16:36:19.233011 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 01 16:36:19.233011 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Id: f1c0a7b17511415ea9316dc8e61dc8c9 Sep 01 16:36:19.233011 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-VolumesSnapshotsTestJSON-314566135-project Sep 01 16:36:19.233011 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: method: Sep 01 16:36:19.233011 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: exception: Volume 55b85467-791e-4892-85cf-17c7038bbba5 could not be found. Sep 01 16:36:19.233011 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: action_args: {'id': '55b85467-791e-4892-85cf-17c7038bbba5'} Sep 01 16:36:19.233011 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:36:19.234012 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:36:19.234012 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:36:19.234012 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:36:19.234012 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 16:36:19.234012 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 16:36:19.234012 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 16:36:19.234012 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 16:36:19.234012 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 16:36:19.234012 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 16:36:19.234012 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 16:36:19.234012 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 16:36:19.234012 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:36:19.234012 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:36:19.234012 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:36:19.234012 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:36:19.234012 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 55b85467-791e-4892-85cf-17c7038bbba5 could not be found. (HTTP 404) (Request-ID: req-d9770cba-e15e-488a-9e67-01937c271c64) Sep 01 16:36:19.234012 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:36:19.234012 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:36:19.234012 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:36:19.235263 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:36:19.235263 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 16:36:19.235263 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 16:36:19.235263 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 16:36:19.235263 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 16:36:19.235263 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 16:36:19.235263 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 16:36:19.235263 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 16:36:19.235263 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 16:36:19.235263 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:36:19.235263 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:36:19.235263 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 16:36:19.235263 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 16:36:19.235263 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 16:36:19.235263 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 16:36:19.235263 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 16:36:19.235263 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 16:36:19.235263 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 16:36:19.235263 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 16:36:19.236340 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:36:19.236340 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:36:19.236340 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:36:19.236340 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:36:19.236340 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 55b85467-791e-4892-85cf-17c7038bbba5 could not be found. Sep 01 16:36:19.236340 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:36:19.236340 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:36:19.236340 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:36:19.236340 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:36:19.236340 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:36:19.236340 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:36:19.236340 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:36:19.236340 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:36:19.236340 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 16:36:19.236340 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 16:36:19.236340 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:36:19.236340 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:36:19.236340 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 16:36:19.236340 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:36:19.237378 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 55b85467-791e-4892-85cf-17c7038bbba5 could not be found. Sep 01 16:36:19.237378 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:36:19.237378 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:36:19.237378 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:36:19.237378 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:36:19.237378 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:36:19.237378 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:36:19.237378 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:36:19.237378 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:36:19.237378 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 55b85467-791e-4892-85cf-17c7038bbba5 could not be found. Sep 01 16:36:19.237378 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:36:19.240910 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3a24f286-781d-4243-967c-4c99c49682be tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] Returning 404 to user: Volume 55b85467-791e-4892-85cf-17c7038bbba5 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:36:19.242379 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3a24f286-781d-4243-967c-4c99c49682be tempest-VolumesSnapshotsTestJSON-314566135 tempest-VolumesSnapshotsTestJSON-314566135-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/55b85467-791e-4892-85cf-17c7038bbba5" status: 404 len: 109 microversion: 2.1 time: 0.052219 Sep 01 16:36:19.243089 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 15/27] 10.222.0.62 () {58 vars in 1245 bytes} [Thu Sep 1 16:36:19 2022] GET /compute/v2.1/os-volumes/55b85467-791e-4892-85cf-17c7038bbba5 => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:36:21.495481 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-22a2a0f6-8364-4fd8-be6e-ced3ced9638f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Action: 'create', calling method: .version_select at 0x7f94831d94c0>, body: {"keypair": {"name": "tempest-keypair-1021103441", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRm/OhZ4TVcW8HfyvMmupG8sNzvmwqvX6J7rNml8zltoV7sleCz8tnjTP+PUwiY2lwPf+4vdcbj5VYx3okT7DV9Nhx/R2NYTJ9T58Y+CJWEFLdN831+g1ixThOKhSY0Pg=="}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:21.603338 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-22a2a0f6-8364-4fd8-be6e-ced3ced9638f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Getting quotas for project 6470f32e4a954dcab3e0ccdd2736c1f6. Resources: {'key_pairs'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:36:21.612468 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-22a2a0f6-8364-4fd8-be6e-ced3ced9638f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Getting quotas for user 849f875ede78424c81919df6d9c152dd and project 6470f32e4a954dcab3e0ccdd2736c1f6. Resources: {'key_pairs'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:36:21.706452 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-22a2a0f6-8364-4fd8-be6e-ced3ced9638f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.788723 Sep 01 16:36:21.711000 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 13/28] 10.222.0.62 () {62 vars in 1200 bytes} [Thu Sep 1 16:36:20 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 794 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 01 16:36:24.563133 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2a4decb6-d14a-49cb-b1a1-8553993279ee tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1860138450", "imageRef": "49e5276c-002c-454f-8be8-76deb18b6b28", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:24.601748 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0ac709e9-0704-47c9-a425-8c3e4780fe8b tempest-VolumesTestJSON-532980698 tempest-VolumesTestJSON-532980698-project] Calling method '.version_select at 0x7f9483137f70>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:24.714293 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-0ac709e9-0704-47c9-a425-8c3e4780fe8b tempest-VolumesTestJSON-532980698 tempest-VolumesTestJSON-532980698-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/1695aa18-caf7-4e6f-a30a-34bf9567a4c9" status: 200 len: 351 microversion: 2.1 time: 0.117193 Sep 01 16:36:24.719133 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 14/29] 10.222.0.62 () {58 vars in 1245 bytes} [Thu Sep 1 16:36:24 2022] GET /compute/v2.1/os-volumes/1695aa18-caf7-4e6f-a30a-34bf9567a4c9 => generated 351 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:36:24.845587 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.network.neutron [None req-2a4decb6-d14a-49cb-b1a1-8553993279ee tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] validate_networks() for [('967eb9b1-fc6a-40cb-af43-8e082044e4cb', None, None, None, None, None)] {{(pid=127198) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:36:26.646900 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e4d17fd5-5f4f-4a03-adf3-e9b70c75a26c tempest-VolumesTestJSON-532980698 tempest-VolumesTestJSON-532980698-project] Calling method '.version_select at 0x7f94830f3670>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:26.859293 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e4d17fd5-5f4f-4a03-adf3-e9b70c75a26c tempest-VolumesTestJSON-532980698 tempest-VolumesTestJSON-532980698-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/d8be09ea-3ce0-4923-a826-d24ce6f0e814" status: 200 len: 351 microversion: 2.1 time: 0.225699 Sep 01 16:36:26.867969 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 15/30] 10.222.0.62 () {58 vars in 1245 bytes} [Thu Sep 1 16:36:26 2022] GET /compute/v2.1/os-volumes/d8be09ea-3ce0-4923-a826-d24ce6f0e814 => generated 351 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:36:27.313287 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-1de3d4b8-5ebc-4311-96e9-f313ca3a433e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Action: 'create', calling method: .version_select at 0x7f94830f3d30>, body: {"keypair": {"name": "tempest-keypair-1519976901", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWdoQcnv9Pm61r4hE5joHXEDbUps3gMnyUCNrBp0YafmfnlNb3dTL7GALayITVk1yRjyR1muBUsBn/DAn7A6V0IQBaEmMSX1vMdhuvsI2/9jrwSqUeUIruO2J1tpECy0g=="}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:27.337173 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-1de3d4b8-5ebc-4311-96e9-f313ca3a433e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Getting quotas for project af2ea34aea99498eb36647be71aec5e8. Resources: {'key_pairs'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:36:27.343382 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-1de3d4b8-5ebc-4311-96e9-f313ca3a433e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Getting quotas for user 2c1c3f8f28b147fc838533baf62b72af and project af2ea34aea99498eb36647be71aec5e8. Resources: {'key_pairs'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:36:27.411524 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-1de3d4b8-5ebc-4311-96e9-f313ca3a433e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.471361 Sep 01 16:36:27.421482 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 16/31] 10.222.0.62 () {60 vars in 1159 bytes} [Thu Sep 1 16:36:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:36:27.580099 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0c60ca20-d584-4acd-96df-3e361dc246d2 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Action: 'create', calling method: .version_select at 0x7f94830fd160>, body: {"keypair": {"name": "tempest-keypair-720016507", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHed3io7sfqZSIc2D5z/KnSanEWhPE59EfjgpNEZCdZE4bqnup4HrTiSlrQG0tvImpqRskMX4OntoGW7IwzCjPaLHJ237SryX4peJUR7SjL8x7RuC75Ik9KjSOEPXHcN3Q=="}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:27.626574 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-0c60ca20-d584-4acd-96df-3e361dc246d2 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Getting quotas for project c6eb3ba21eae45898f42f3456591591e. Resources: {'key_pairs'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:36:27.641034 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-0c60ca20-d584-4acd-96df-3e361dc246d2 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Getting quotas for user 3a9b222396b1438f9fa0af0e197a9293 and project c6eb3ba21eae45898f42f3456591591e. Resources: {'key_pairs'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:36:27.700949 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-0c60ca20-d584-4acd-96df-3e361dc246d2 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.275787 Sep 01 16:36:27.701727 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 17/32] 10.222.0.62 () {60 vars in 1159 bytes} [Thu Sep 1 16:36:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:36:28.422789 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-2a4decb6-d14a-49cb-b1a1-8553993279ee tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Flavor limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:36:28.423879 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-2a4decb6-d14a-49cb-b1a1-8553993279ee tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Image limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:36:28.425055 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-2a4decb6-d14a-49cb-b1a1-8553993279ee tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Flavor pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:36:28.425736 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-2a4decb6-d14a-49cb-b1a1-8553993279ee tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Image pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:36:28.426909 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-2a4decb6-d14a-49cb-b1a1-8553993279ee tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:36:28.492528 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2a4decb6-d14a-49cb-b1a1-8553993279ee tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:28.493581 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2a4decb6-d14a-49cb-b1a1-8553993279ee tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:28.495218 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2a4decb6-d14a-49cb-b1a1-8553993279ee tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:28.499301 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2a4decb6-d14a-49cb-b1a1-8553993279ee tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:28.500023 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2a4decb6-d14a-49cb-b1a1-8553993279ee tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:28.500563 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2a4decb6-d14a-49cb-b1a1-8553993279ee tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:28.626388 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-2a4decb6-d14a-49cb-b1a1-8553993279ee tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Getting quotas for project 601c248b5d9b48488351cb4d9561a2f4. Resources: {'ram', 'cores', 'instances'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:36:28.648405 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-2a4decb6-d14a-49cb-b1a1-8553993279ee tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Getting quotas for user 52760b6736e14ccd8df8aca0015cb292 and project 601c248b5d9b48488351cb4d9561a2f4. Resources: {'ram', 'cores', 'instances'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:36:28.721221 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-2a4decb6-d14a-49cb-b1a1-8553993279ee tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Going to run 1 instances... {{(pid=127198) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:36:28.740867 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-2a4decb6-d14a-49cb-b1a1-8553993279ee tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='49e5276c-002c-454f-8be8-76deb18b6b28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:36:28.745589 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d7d2a1fe-60c4-4aaf-b0bf-8a1ca8899cf6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1307291718", "imageRef": "49e5276c-002c-454f-8be8-76deb18b6b28", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "530d2089-1346-4325-99ed-e2a88eba2319"}], "security_groups": [{"name": "tempest-securitygroup--701099621"}], "key_name": "tempest-keypair-1021103441", "user_data": "}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:29.016247 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2a4decb6-d14a-49cb-b1a1-8553993279ee tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.939919 Sep 01 16:36:29.021346 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 16/33] 10.222.0.62 () {60 vars in 1147 bytes} [Thu Sep 1 16:36:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 4946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:36:29.038334 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1327e105-f91a-4142-b6dc-2818492ea629 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:29.039200 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1327e105-f91a-4142-b6dc-2818492ea629 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:29.488999 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.network.neutron [None req-d7d2a1fe-60c4-4aaf-b0bf-8a1ca8899cf6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] validate_networks() for [('530d2089-1346-4325-99ed-e2a88eba2319', None, None, None, None, None)] {{(pid=127199) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:36:29.517706 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1327e105-f91a-4142-b6dc-2818492ea629 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:29.548955 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1327e105-f91a-4142-b6dc-2818492ea629 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648" status: 200 len: 1222 microversion: 2.1 time: 0.519143 Sep 01 16:36:29.549538 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 17/34] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:29 2022] GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648 => generated 1222 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:29.688959 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-651ec99a-763b-4d58-9052-8dfe3849e25d tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-391531198", "imageRef": "49e5276c-002c-454f-8be8-76deb18b6b28", "flavorRef": "452", "networks": [{"uuid": "1700a131-4612-4e52-90ec-0d8dbea3d26b"}]}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:29.836423 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.network.neutron [None req-651ec99a-763b-4d58-9052-8dfe3849e25d tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] validate_networks() for [('1700a131-4612-4e52-90ec-0d8dbea3d26b', None, None, None, None, None)] {{(pid=127198) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:36:31.217045 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-651ec99a-763b-4d58-9052-8dfe3849e25d tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Flavor limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:36:31.217760 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-651ec99a-763b-4d58-9052-8dfe3849e25d tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Image limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:36:31.218014 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-651ec99a-763b-4d58-9052-8dfe3849e25d tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Flavor pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:36:31.218338 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-651ec99a-763b-4d58-9052-8dfe3849e25d tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Image pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:36:31.218749 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-651ec99a-763b-4d58-9052-8dfe3849e25d tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:36:31.265083 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-651ec99a-763b-4d58-9052-8dfe3849e25d tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:31.265589 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-651ec99a-763b-4d58-9052-8dfe3849e25d tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:31.266033 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-651ec99a-763b-4d58-9052-8dfe3849e25d tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:31.280519 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-651ec99a-763b-4d58-9052-8dfe3849e25d tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:31.281062 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-651ec99a-763b-4d58-9052-8dfe3849e25d tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:31.281515 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-651ec99a-763b-4d58-9052-8dfe3849e25d tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:31.358217 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-651ec99a-763b-4d58-9052-8dfe3849e25d tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Getting quotas for project 130966aabcc04fc98c9f5139f826e78f. Resources: {'ram', 'cores', 'instances'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:36:31.367497 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-651ec99a-763b-4d58-9052-8dfe3849e25d tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Getting quotas for user f21b1fea950d48ef9a55cded8ed172a6 and project 130966aabcc04fc98c9f5139f826e78f. Resources: {'ram', 'cores', 'instances'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:36:31.398630 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-651ec99a-763b-4d58-9052-8dfe3849e25d tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Going to run 1 instances... {{(pid=127198) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:36:31.410167 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-651ec99a-763b-4d58-9052-8dfe3849e25d tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] [instance: 5bd544a7-a62e-434f-a842-e6231482d926] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='49e5276c-002c-454f-8be8-76deb18b6b28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:36:31.532344 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-651ec99a-763b-4d58-9052-8dfe3849e25d tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.970923 Sep 01 16:36:31.534861 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 18/35] 10.222.0.62 () {60 vars in 1147 bytes} [Thu Sep 1 16:36:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:36:31.546198 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9137377f-1837-4fae-9cb7-38d4247495a0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1209062613", "imageRef": "49e5276c-002c-454f-8be8-76deb18b6b28", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:31.661986 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.network.neutron [None req-9137377f-1837-4fae-9cb7-38d4247495a0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] validate_networks() for [('967eb9b1-fc6a-40cb-af43-8e082044e4cb', None, None, None, None, None)] {{(pid=127198) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:36:31.778386 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-d7d2a1fe-60c4-4aaf-b0bf-8a1ca8899cf6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Flavor limits 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:36:31.779462 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-d7d2a1fe-60c4-4aaf-b0bf-8a1ca8899cf6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Image limits 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:36:31.780129 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-d7d2a1fe-60c4-4aaf-b0bf-8a1ca8899cf6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Flavor pref 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:36:31.780694 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-d7d2a1fe-60c4-4aaf-b0bf-8a1ca8899cf6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Image pref 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:36:31.781237 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-d7d2a1fe-60c4-4aaf-b0bf-8a1ca8899cf6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:36:31.802688 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d7d2a1fe-60c4-4aaf-b0bf-8a1ca8899cf6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:31.804056 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d7d2a1fe-60c4-4aaf-b0bf-8a1ca8899cf6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:31.804837 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d7d2a1fe-60c4-4aaf-b0bf-8a1ca8899cf6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:31.805921 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d7d2a1fe-60c4-4aaf-b0bf-8a1ca8899cf6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:31.806577 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d7d2a1fe-60c4-4aaf-b0bf-8a1ca8899cf6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:31.807539 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d7d2a1fe-60c4-4aaf-b0bf-8a1ca8899cf6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:31.850184 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-d7d2a1fe-60c4-4aaf-b0bf-8a1ca8899cf6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Getting quotas for project 6470f32e4a954dcab3e0ccdd2736c1f6. Resources: {'ram', 'cores', 'instances'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:36:31.861101 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-d7d2a1fe-60c4-4aaf-b0bf-8a1ca8899cf6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Getting quotas for user 849f875ede78424c81919df6d9c152dd and project 6470f32e4a954dcab3e0ccdd2736c1f6. Resources: {'ram', 'cores', 'instances'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:36:31.877444 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d7d2a1fe-60c4-4aaf-b0bf-8a1ca8899cf6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Going to run 1 instances... {{(pid=127199) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:36:31.889388 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d7d2a1fe-60c4-4aaf-b0bf-8a1ca8899cf6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='49e5276c-002c-454f-8be8-76deb18b6b28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:36:31.993050 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d7d2a1fe-60c4-4aaf-b0bf-8a1ca8899cf6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.259518 Sep 01 16:36:31.994703 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 18/36] 10.222.0.62 () {62 vars in 1188 bytes} [Thu Sep 1 16:36:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 3264 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 01 16:36:32.008967 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-af557b8a-cfd8-4d5a-8bb4-f3d6fc1eeb89 tempest-VolumesTestJSON-532980698 tempest-VolumesTestJSON-532980698-project] Calling method '.version_select at 0x7f9483084a60>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:32.108308 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-af557b8a-cfd8-4d5a-8bb4-f3d6fc1eeb89 tempest-VolumesTestJSON-532980698 tempest-VolumesTestJSON-532980698-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/9a03608b-12f5-415f-bf99-b733387ce273" status: 200 len: 351 microversion: 2.1 time: 0.110088 Sep 01 16:36:32.110080 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 19/37] 10.222.0.62 () {58 vars in 1245 bytes} [Thu Sep 1 16:36:31 2022] GET /compute/v2.1/os-volumes/9a03608b-12f5-415f-bf99-b733387ce273 => generated 351 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:36:32.121003 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-737233f3-dbc0-4264-959c-9eca3df40d88 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-82854820", "imageRef": "49e5276c-002c-454f-8be8-76deb18b6b28", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8b128f9b-7054-469d-ab8b-4c59b78f775a"}], "security_groups": [{"name": "tempest-securitygroup--90697760"}], "key_name": "tempest-keypair-1519976901", "user_data": "}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:32.504663 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.network.neutron [None req-737233f3-dbc0-4264-959c-9eca3df40d88 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] validate_networks() for [('8b128f9b-7054-469d-ab8b-4c59b78f775a', None, None, None, None, None)] {{(pid=127199) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:36:33.332147 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-9137377f-1837-4fae-9cb7-38d4247495a0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Flavor limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:36:33.332624 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-9137377f-1837-4fae-9cb7-38d4247495a0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Image limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:36:33.333064 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-9137377f-1837-4fae-9cb7-38d4247495a0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Flavor pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:36:33.333659 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-9137377f-1837-4fae-9cb7-38d4247495a0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Image pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:36:33.334032 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-9137377f-1837-4fae-9cb7-38d4247495a0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:36:33.369153 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9137377f-1837-4fae-9cb7-38d4247495a0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:33.369707 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9137377f-1837-4fae-9cb7-38d4247495a0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:33.370311 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9137377f-1837-4fae-9cb7-38d4247495a0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:33.370945 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9137377f-1837-4fae-9cb7-38d4247495a0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:33.371450 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9137377f-1837-4fae-9cb7-38d4247495a0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:33.371946 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9137377f-1837-4fae-9cb7-38d4247495a0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:33.449643 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-9137377f-1837-4fae-9cb7-38d4247495a0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Getting quotas for project 601c248b5d9b48488351cb4d9561a2f4. Resources: {'ram', 'cores', 'instances'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:36:33.458959 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-9137377f-1837-4fae-9cb7-38d4247495a0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Getting quotas for user 52760b6736e14ccd8df8aca0015cb292 and project 601c248b5d9b48488351cb4d9561a2f4. Resources: {'ram', 'cores', 'instances'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:36:33.476797 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9137377f-1837-4fae-9cb7-38d4247495a0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Going to run 1 instances... {{(pid=127198) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:36:33.479066 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9137377f-1837-4fae-9cb7-38d4247495a0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='49e5276c-002c-454f-8be8-76deb18b6b28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:36:33.507177 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-737233f3-dbc0-4264-959c-9eca3df40d88 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Flavor limits 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:36:33.507757 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-737233f3-dbc0-4264-959c-9eca3df40d88 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Image limits 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:36:33.508832 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-737233f3-dbc0-4264-959c-9eca3df40d88 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Flavor pref 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:36:33.509395 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-737233f3-dbc0-4264-959c-9eca3df40d88 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Image pref 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:36:33.510137 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-737233f3-dbc0-4264-959c-9eca3df40d88 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:36:33.528153 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-737233f3-dbc0-4264-959c-9eca3df40d88 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:33.529539 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-737233f3-dbc0-4264-959c-9eca3df40d88 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:33.530876 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-737233f3-dbc0-4264-959c-9eca3df40d88 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:33.536577 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-737233f3-dbc0-4264-959c-9eca3df40d88 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:33.537095 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-737233f3-dbc0-4264-959c-9eca3df40d88 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:33.537536 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-737233f3-dbc0-4264-959c-9eca3df40d88 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:33.581870 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9137377f-1837-4fae-9cb7-38d4247495a0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.045651 Sep 01 16:36:33.592059 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 19/38] 10.222.0.62 () {60 vars in 1147 bytes} [Thu Sep 1 16:36:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 2056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:36:33.592759 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-737233f3-dbc0-4264-959c-9eca3df40d88 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Getting quotas for project af2ea34aea99498eb36647be71aec5e8. Resources: {'ram', 'cores', 'instances'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:36:33.604365 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b87c883c-ebf8-4466-9e43-72cffd70baa4 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:33.605242 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b87c883c-ebf8-4466-9e43-72cffd70baa4 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] [instance: 5bd544a7-a62e-434f-a842-e6231482d926] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:33.616885 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b87c883c-ebf8-4466-9e43-72cffd70baa4 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:33.617409 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b87c883c-ebf8-4466-9e43-72cffd70baa4 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:33.618403 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b87c883c-ebf8-4466-9e43-72cffd70baa4 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:33.619382 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b87c883c-ebf8-4466-9e43-72cffd70baa4 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:33.619849 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b87c883c-ebf8-4466-9e43-72cffd70baa4 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:33.620298 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b87c883c-ebf8-4466-9e43-72cffd70baa4 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:33.631969 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-737233f3-dbc0-4264-959c-9eca3df40d88 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Getting quotas for user 2c1c3f8f28b147fc838533baf62b72af and project af2ea34aea99498eb36647be71aec5e8. Resources: {'ram', 'cores', 'instances'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:36:33.673126 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-737233f3-dbc0-4264-959c-9eca3df40d88 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Going to run 1 instances... {{(pid=127199) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:36:33.676695 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-737233f3-dbc0-4264-959c-9eca3df40d88 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='49e5276c-002c-454f-8be8-76deb18b6b28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:36:33.800839 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b87c883c-ebf8-4466-9e43-72cffd70baa4 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b1fea950d48ef9a55cded8ed172a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130966aabcc04fc98c9f5139f826e78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:33.818934 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b87c883c-ebf8-4466-9e43-72cffd70baa4 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] 10.222.0.62 "GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926" status: 200 len: 1218 microversion: 2.1 time: 0.224375 Sep 01 16:36:33.819839 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 20/39] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:33 2022] GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926 => generated 1218 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:33.828061 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ffaabfa0-3264-4ba8-933e-3c62cc535f5f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:33.833028 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ffaabfa0-3264-4ba8-933e-3c62cc535f5f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:33.840874 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-737233f3-dbc0-4264-959c-9eca3df40d88 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.729264 Sep 01 16:36:33.841767 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 20/40] 10.222.0.62 () {60 vars in 1147 bytes} [Thu Sep 1 16:36:32 2022] POST /compute/v2.1/servers => generated 400 bytes in 1731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:36:33.847253 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-6709861d-a6bd-42ef-9be3-d3fba3ce6e77 tempest-VolumesTestJSON-532980698 tempest-VolumesTestJSON-532980698-project] Calling method '.version_select at 0x7f948309ca60>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:33.924676 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ffaabfa0-3264-4ba8-933e-3c62cc535f5f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:33.937100 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ffaabfa0-3264-4ba8-933e-3c62cc535f5f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:33.938937 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ffaabfa0-3264-4ba8-933e-3c62cc535f5f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:33.940371 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ffaabfa0-3264-4ba8-933e-3c62cc535f5f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1282 microversion: 2.20 time: 0.119504 Sep 01 16:36:33.941474 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 21/41] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:33 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1282 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:36:33.948320 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7bfe58ac-2543-47a1-b134-ec7d6a87949d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-603390716", "imageRef": "49e5276c-002c-454f-8be8-76deb18b6b28", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3ad8e59d-1d82-4cdb-9afd-98e6a7c8e50a"}], "security_groups": [{"name": "tempest-securitygroup--1136444178"}], "key_name": "tempest-keypair-720016507", "user_data": "}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:33.984176 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-6709861d-a6bd-42ef-9be3-d3fba3ce6e77 tempest-VolumesTestJSON-532980698 tempest-VolumesTestJSON-532980698-project] 10.222.0.62 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.140693 Sep 01 16:36:33.986060 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 21/42] 10.222.0.62 () {58 vars in 1134 bytes} [Thu Sep 1 16:36:33 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:33.992192 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-9ed4e5a6-eeb3-4233-b067-266096c203bd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:33.996233 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-9ed4e5a6-eeb3-4233-b067-266096c203bd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:34.104764 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-9ed4e5a6-eeb3-4233-b067-266096c203bd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:34.137837 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-9ed4e5a6-eeb3-4233-b067-266096c203bd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1222 microversion: 2.1 time: 0.149000 Sep 01 16:36:34.140931 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 22/43] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:33 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1222 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:34.153477 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8f471d33-3442-4cb5-9633-a118347a22df tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:34.154486 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-8f471d33-3442-4cb5-9633-a118347a22df tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:34.322709 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.network.neutron [None req-7bfe58ac-2543-47a1-b134-ec7d6a87949d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] validate_networks() for [('3ad8e59d-1d82-4cdb-9afd-98e6a7c8e50a', None, None, None, None, None)] {{(pid=127198) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:36:34.379491 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8f471d33-3442-4cb5-9633-a118347a22df tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:34.389853 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8f471d33-3442-4cb5-9633-a118347a22df tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1236 microversion: 2.1 time: 0.247575 Sep 01 16:36:34.416030 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 23/44] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:34 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1236 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:34.437673 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-cfb3cddc-7aed-4374-aa70-b868c670c6cc tempest-VolumesTestJSON-532980698 tempest-VolumesTestJSON-532980698-project] Calling method '.version_select at 0x7f9482843f70>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:34.740240 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-cfb3cddc-7aed-4374-aa70-b868c670c6cc tempest-VolumesTestJSON-532980698 tempest-VolumesTestJSON-532980698-project] 10.222.0.62 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.313141 Sep 01 16:36:34.742108 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 24/45] 10.222.0.62 () {58 vars in 1149 bytes} [Thu Sep 1 16:36:34 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:36:34.756712 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-96584eaf-5d73-41db-a864-5a84cccb78f7 tempest-VolumesTestJSON-532980698 tempest-VolumesTestJSON-532980698-project] Calling method '.version_select at 0x7f9482843af0>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:34.897018 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-96584eaf-5d73-41db-a864-5a84cccb78f7 tempest-VolumesTestJSON-532980698 tempest-VolumesTestJSON-532980698-project] 10.222.0.62 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.145079 Sep 01 16:36:34.906613 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 25/46] 10.222.0.62 () {58 vars in 1134 bytes} [Thu Sep 1 16:36:34 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:34.912056 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-f8bc7034-fb87-49e5-b641-3599691ba099 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:34.912925 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-f8bc7034-fb87-49e5-b641-3599691ba099 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] [instance: 5bd544a7-a62e-434f-a842-e6231482d926] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:34.955806 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f8bc7034-fb87-49e5-b641-3599691ba099 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:34.956907 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f8bc7034-fb87-49e5-b641-3599691ba099 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:34.960476 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f8bc7034-fb87-49e5-b641-3599691ba099 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:34.966644 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f8bc7034-fb87-49e5-b641-3599691ba099 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:34.969614 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f8bc7034-fb87-49e5-b641-3599691ba099 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:34.970401 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f8bc7034-fb87-49e5-b641-3599691ba099 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:35.378310 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-7bfe58ac-2543-47a1-b134-ec7d6a87949d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Flavor limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:36:35.379459 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-7bfe58ac-2543-47a1-b134-ec7d6a87949d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Image limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:36:35.380169 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-7bfe58ac-2543-47a1-b134-ec7d6a87949d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Flavor pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:36:35.380951 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-7bfe58ac-2543-47a1-b134-ec7d6a87949d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Image pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:36:35.381593 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-7bfe58ac-2543-47a1-b134-ec7d6a87949d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:36:35.406962 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7bfe58ac-2543-47a1-b134-ec7d6a87949d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:35.408354 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7bfe58ac-2543-47a1-b134-ec7d6a87949d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:35.410157 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7bfe58ac-2543-47a1-b134-ec7d6a87949d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:35.412878 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7bfe58ac-2543-47a1-b134-ec7d6a87949d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:35.414894 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7bfe58ac-2543-47a1-b134-ec7d6a87949d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:35.415522 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7bfe58ac-2543-47a1-b134-ec7d6a87949d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:35.475171 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-7bfe58ac-2543-47a1-b134-ec7d6a87949d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Getting quotas for project c6eb3ba21eae45898f42f3456591591e. Resources: {'ram', 'cores', 'instances'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:36:35.486140 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-7bfe58ac-2543-47a1-b134-ec7d6a87949d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Getting quotas for user 3a9b222396b1438f9fa0af0e197a9293 and project c6eb3ba21eae45898f42f3456591591e. Resources: {'ram', 'cores', 'instances'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:36:35.499849 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7bfe58ac-2543-47a1-b134-ec7d6a87949d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Going to run 1 instances... {{(pid=127198) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:36:35.500554 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-f8bc7034-fb87-49e5-b641-3599691ba099 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b1fea950d48ef9a55cded8ed172a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130966aabcc04fc98c9f5139f826e78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:35.502359 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7bfe58ac-2543-47a1-b134-ec7d6a87949d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: b16ceffd-c9b2-49e6-a44d-7353a17f230a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='49e5276c-002c-454f-8be8-76deb18b6b28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:36:35.529777 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-f8bc7034-fb87-49e5-b641-3599691ba099 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] 10.222.0.62 "GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926" status: 200 len: 1266 microversion: 2.1 time: 0.621714 Sep 01 16:36:35.530949 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 26/47] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:34 2022] GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926 => generated 1266 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:35.544377 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-2ba544b1-ffb4-4727-a21e-af5021752cdf tempest-VolumesTestJSON-532980698 tempest-VolumesTestJSON-532980698-project] Calling method '.version_select at 0x7f94827b9430>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:35.606512 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7bfe58ac-2543-47a1-b134-ec7d6a87949d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.662237 Sep 01 16:36:35.607660 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 22/48] 10.222.0.62 () {60 vars in 1147 bytes} [Thu Sep 1 16:36:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 1665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:36:35.624908 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-efc96cd0-53a9-401f-9bc8-36a7049f6278 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:35.625811 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-efc96cd0-53a9-401f-9bc8-36a7049f6278 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:35.676084 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-efc96cd0-53a9-401f-9bc8-36a7049f6278 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:35.676722 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-efc96cd0-53a9-401f-9bc8-36a7049f6278 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:35.685674 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-efc96cd0-53a9-401f-9bc8-36a7049f6278 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:35.690389 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-efc96cd0-53a9-401f-9bc8-36a7049f6278 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:35.693764 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-efc96cd0-53a9-401f-9bc8-36a7049f6278 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:35.694226 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-efc96cd0-53a9-401f-9bc8-36a7049f6278 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:35.754340 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-2ba544b1-ffb4-4727-a21e-af5021752cdf tempest-VolumesTestJSON-532980698 tempest-VolumesTestJSON-532980698-project] 10.222.0.62 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.222095 Sep 01 16:36:35.767130 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 27/49] 10.222.0.62 () {58 vars in 1167 bytes} [Thu Sep 1 16:36:35 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:36:35.775381 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-f429af5d-5bb2-400a-ad6d-9928578855e7 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:35.776387 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-f429af5d-5bb2-400a-ad6d-9928578855e7 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:35.786553 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f429af5d-5bb2-400a-ad6d-9928578855e7 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:35.787649 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f429af5d-5bb2-400a-ad6d-9928578855e7 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:35.788370 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f429af5d-5bb2-400a-ad6d-9928578855e7 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:35.789394 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f429af5d-5bb2-400a-ad6d-9928578855e7 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:35.790238 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f429af5d-5bb2-400a-ad6d-9928578855e7 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:35.791653 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f429af5d-5bb2-400a-ad6d-9928578855e7 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:35.922886 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-f429af5d-5bb2-400a-ad6d-9928578855e7 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:35.943620 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-f429af5d-5bb2-400a-ad6d-9928578855e7 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1274 microversion: 2.1 time: 0.167615 Sep 01 16:36:35.944305 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 28/50] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:35 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1274 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:35.959710 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8b13c5cf-2d01-41c3-b282-d7d1b7d6e80b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:35.964315 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-8b13c5cf-2d01-41c3-b282-d7d1b7d6e80b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:35.995550 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8b13c5cf-2d01-41c3-b282-d7d1b7d6e80b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:35.998636 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8b13c5cf-2d01-41c3-b282-d7d1b7d6e80b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:35.999117 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8b13c5cf-2d01-41c3-b282-d7d1b7d6e80b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:36.005876 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8b13c5cf-2d01-41c3-b282-d7d1b7d6e80b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:36.008566 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8b13c5cf-2d01-41c3-b282-d7d1b7d6e80b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:36.010314 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8b13c5cf-2d01-41c3-b282-d7d1b7d6e80b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:36.071637 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-efc96cd0-53a9-401f-9bc8-36a7049f6278 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:36.101178 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-efc96cd0-53a9-401f-9bc8-36a7049f6278 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:36.104248 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-efc96cd0-53a9-401f-9bc8-36a7049f6278 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:36.117104 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-efc96cd0-53a9-401f-9bc8-36a7049f6278 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1334 microversion: 2.20 time: 0.489516 Sep 01 16:36:36.120131 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 23/51] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:35 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1334 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:36:36.145553 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-20d1a9d7-aa64-48c1-93d6-61933f5361b5 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:36.146331 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-20d1a9d7-aa64-48c1-93d6-61933f5361b5 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: b16ceffd-c9b2-49e6-a44d-7353a17f230a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:36.207040 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8b13c5cf-2d01-41c3-b282-d7d1b7d6e80b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:36.223584 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8b13c5cf-2d01-41c3-b282-d7d1b7d6e80b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1288 microversion: 2.1 time: 0.276303 Sep 01 16:36:36.224411 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 29/52] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:35 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1288 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:36.232735 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7e801bb4-098e-4d76-9ea7-8839ee7ef540 tempest-VolumesTestJSON-532980698 tempest-VolumesTestJSON-532980698-project] Calling method '.version_select at 0x7f948279b3a0>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:36.361933 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-20d1a9d7-aa64-48c1-93d6-61933f5361b5 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:36.379089 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-20d1a9d7-aa64-48c1-93d6-61933f5361b5 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a" status: 200 len: 1240 microversion: 2.1 time: 0.252169 Sep 01 16:36:36.386567 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 24/53] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:36 2022] GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a => generated 1240 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:36.551874 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-635a2e10-2552-41f3-a574-73f6f438f74c tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:36.554166 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-7e801bb4-098e-4d76-9ea7-8839ee7ef540 tempest-VolumesTestJSON-532980698 tempest-VolumesTestJSON-532980698-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.328446 Sep 01 16:36:36.556108 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-635a2e10-2552-41f3-a574-73f6f438f74c tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] [instance: 5bd544a7-a62e-434f-a842-e6231482d926] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:36.563418 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 30/54] 10.222.0.62 () {58 vars in 1170 bytes} [Thu Sep 1 16:36:36 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:36:36.572919 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-124d4391-f58f-41b1-9965-70eda0f3261f tempest-VolumesTestJSON-532980698 tempest-VolumesTestJSON-532980698-project] Calling method '.version_select at 0x7f94827c2280>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:36.573617 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-635a2e10-2552-41f3-a574-73f6f438f74c tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:36.574985 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-635a2e10-2552-41f3-a574-73f6f438f74c tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:36.575562 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-635a2e10-2552-41f3-a574-73f6f438f74c tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:36.576327 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-635a2e10-2552-41f3-a574-73f6f438f74c tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:36.576791 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-635a2e10-2552-41f3-a574-73f6f438f74c tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:36.577216 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-635a2e10-2552-41f3-a574-73f6f438f74c tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:37.053289 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-124d4391-f58f-41b1-9965-70eda0f3261f tempest-VolumesTestJSON-532980698 tempest-VolumesTestJSON-532980698-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.488461 Sep 01 16:36:37.067830 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 31/55] 10.222.0.62 () {58 vars in 1155 bytes} [Thu Sep 1 16:36:36 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:37.085626 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b687283f-debc-4e81-b371-3c83d99bd451 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:37.087708 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-b687283f-debc-4e81-b371-3c83d99bd451 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:37.122299 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b687283f-debc-4e81-b371-3c83d99bd451 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:37.124716 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b687283f-debc-4e81-b371-3c83d99bd451 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:37.125413 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b687283f-debc-4e81-b371-3c83d99bd451 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:37.126329 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b687283f-debc-4e81-b371-3c83d99bd451 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:37.129286 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b687283f-debc-4e81-b371-3c83d99bd451 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:37.129907 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b687283f-debc-4e81-b371-3c83d99bd451 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:37.534049 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b687283f-debc-4e81-b371-3c83d99bd451 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:37.545954 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-b687283f-debc-4e81-b371-3c83d99bd451 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1274 microversion: 2.1 time: 0.476557 Sep 01 16:36:37.551785 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 32/56] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:37 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1274 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:37.568318 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-4ae8e38f-1e0b-4ab4-a990-304143d45cdb tempest-VolumesTestJSON-532980698 tempest-VolumesTestJSON-532980698-project] Calling method '.version_select at 0x7f94827c28b0>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:37.609562 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-635a2e10-2552-41f3-a574-73f6f438f74c tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b1fea950d48ef9a55cded8ed172a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130966aabcc04fc98c9f5139f826e78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:37.621484 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-635a2e10-2552-41f3-a574-73f6f438f74c tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] 10.222.0.62 "GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926" status: 200 len: 1274 microversion: 2.1 time: 1.073542 Sep 01 16:36:37.628889 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 25/57] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:36 2022] GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926 => generated 1274 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:37.637432 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b21c9b39-2308-4132-b6bc-481b7fc97356 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:37.647645 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b21c9b39-2308-4132-b6bc-481b7fc97356 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:37.670632 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b21c9b39-2308-4132-b6bc-481b7fc97356 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:37.671522 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b21c9b39-2308-4132-b6bc-481b7fc97356 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:37.681270 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b21c9b39-2308-4132-b6bc-481b7fc97356 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:37.682091 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b21c9b39-2308-4132-b6bc-481b7fc97356 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:37.682567 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b21c9b39-2308-4132-b6bc-481b7fc97356 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:37.685877 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b21c9b39-2308-4132-b6bc-481b7fc97356 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:37.777831 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-4ae8e38f-1e0b-4ab4-a990-304143d45cdb tempest-VolumesTestJSON-532980698 tempest-VolumesTestJSON-532980698-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.224438 Sep 01 16:36:37.778453 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 33/58] 10.222.0.62 () {58 vars in 1188 bytes} [Thu Sep 1 16:36:37 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:36:37.783342 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7f20d736-ddca-4202-9874-95f9aa68341e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:37.784219 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-7f20d736-ddca-4202-9874-95f9aa68341e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:37.807292 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7f20d736-ddca-4202-9874-95f9aa68341e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:37.808105 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7f20d736-ddca-4202-9874-95f9aa68341e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:37.808774 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7f20d736-ddca-4202-9874-95f9aa68341e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:37.809821 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7f20d736-ddca-4202-9874-95f9aa68341e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:37.810437 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7f20d736-ddca-4202-9874-95f9aa68341e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:37.811003 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7f20d736-ddca-4202-9874-95f9aa68341e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:37.871088 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b21c9b39-2308-4132-b6bc-481b7fc97356 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:37.888016 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b21c9b39-2308-4132-b6bc-481b7fc97356 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:37.894271 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b21c9b39-2308-4132-b6bc-481b7fc97356 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:37.900720 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b21c9b39-2308-4132-b6bc-481b7fc97356 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1340 microversion: 2.20 time: 0.270099 Sep 01 16:36:37.901961 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 26/59] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:37 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1340 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:36:37.907461 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a08c025a-340f-4ce8-91e7-04cd82e14119 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:37.908414 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a08c025a-340f-4ce8-91e7-04cd82e14119 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: b16ceffd-c9b2-49e6-a44d-7353a17f230a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:37.919908 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a08c025a-340f-4ce8-91e7-04cd82e14119 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:37.920833 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a08c025a-340f-4ce8-91e7-04cd82e14119 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:37.921485 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a08c025a-340f-4ce8-91e7-04cd82e14119 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:37.922908 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a08c025a-340f-4ce8-91e7-04cd82e14119 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:37.923795 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a08c025a-340f-4ce8-91e7-04cd82e14119 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:37.924453 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a08c025a-340f-4ce8-91e7-04cd82e14119 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:37.931905 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-7f20d736-ddca-4202-9874-95f9aa68341e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:37.942590 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-7f20d736-ddca-4202-9874-95f9aa68341e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1296 microversion: 2.1 time: 0.162750 Sep 01 16:36:37.943722 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 34/60] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:37 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1296 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:37.961745 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-06515786-b1a8-4b73-be00-2f6dcae6c25b tempest-VolumesTestJSON-532980698 tempest-VolumesTestJSON-532980698-project] Calling method '.version_select at 0x7f94827c2b80>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:38.058155 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a08c025a-340f-4ce8-91e7-04cd82e14119 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:38.074922 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a08c025a-340f-4ce8-91e7-04cd82e14119 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a" status: 200 len: 1236 microversion: 2.1 time: 0.171361 Sep 01 16:36:38.079319 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 27/61] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:37 2022] GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a => generated 1236 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:38.108084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-06515786-b1a8-4b73-be00-2f6dcae6c25b tempest-VolumesTestJSON-532980698 tempest-VolumesTestJSON-532980698-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.162894 Sep 01 16:36:38.122630 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 35/62] 10.222.0.62 () {58 vars in 1155 bytes} [Thu Sep 1 16:36:37 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:38.572969 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f56aeaf0-b2c0-4c91-886e-dba7445d16a6 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:38.573379 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f56aeaf0-b2c0-4c91-886e-dba7445d16a6 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:38.581887 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f56aeaf0-b2c0-4c91-886e-dba7445d16a6 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:38.582448 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f56aeaf0-b2c0-4c91-886e-dba7445d16a6 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:38.583206 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f56aeaf0-b2c0-4c91-886e-dba7445d16a6 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:38.584479 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f56aeaf0-b2c0-4c91-886e-dba7445d16a6 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:38.584855 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f56aeaf0-b2c0-4c91-886e-dba7445d16a6 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:38.585365 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f56aeaf0-b2c0-4c91-886e-dba7445d16a6 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:38.653891 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8604fd4a-4b24-4e07-be7a-4419eb411722 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:38.654511 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-8604fd4a-4b24-4e07-be7a-4419eb411722 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] [instance: 5bd544a7-a62e-434f-a842-e6231482d926] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:38.672912 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f56aeaf0-b2c0-4c91-886e-dba7445d16a6 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:38.673603 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8604fd4a-4b24-4e07-be7a-4419eb411722 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:38.674352 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8604fd4a-4b24-4e07-be7a-4419eb411722 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:38.674931 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8604fd4a-4b24-4e07-be7a-4419eb411722 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:38.676056 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8604fd4a-4b24-4e07-be7a-4419eb411722 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:38.676656 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8604fd4a-4b24-4e07-be7a-4419eb411722 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:38.677791 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8604fd4a-4b24-4e07-be7a-4419eb411722 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:38.682263 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f56aeaf0-b2c0-4c91-886e-dba7445d16a6 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1282 microversion: 2.1 time: 0.113300 Sep 01 16:36:38.696268 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 28/63] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:38 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1282 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:38.752406 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8604fd4a-4b24-4e07-be7a-4419eb411722 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b1fea950d48ef9a55cded8ed172a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130966aabcc04fc98c9f5139f826e78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:38.766112 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8604fd4a-4b24-4e07-be7a-4419eb411722 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] 10.222.0.62 "GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926" status: 200 len: 1272 microversion: 2.1 time: 0.116702 Sep 01 16:36:38.772611 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 36/64] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:38 2022] GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926 => generated 1272 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:38.926725 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-fa6d337d-6b0c-4833-a9e5-fc80219f6a0f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:38.927701 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-fa6d337d-6b0c-4833-a9e5-fc80219f6a0f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:38.935177 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fa6d337d-6b0c-4833-a9e5-fc80219f6a0f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:38.935799 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fa6d337d-6b0c-4833-a9e5-fc80219f6a0f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:38.936589 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fa6d337d-6b0c-4833-a9e5-fc80219f6a0f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:38.937294 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fa6d337d-6b0c-4833-a9e5-fc80219f6a0f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:38.937749 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fa6d337d-6b0c-4833-a9e5-fc80219f6a0f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:38.938170 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fa6d337d-6b0c-4833-a9e5-fc80219f6a0f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:38.971655 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-9ff5fd82-634f-49b7-a493-46a01bf05e9b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:38.972313 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-9ff5fd82-634f-49b7-a493-46a01bf05e9b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:38.979000 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9ff5fd82-634f-49b7-a493-46a01bf05e9b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:38.979486 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9ff5fd82-634f-49b7-a493-46a01bf05e9b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:38.979935 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9ff5fd82-634f-49b7-a493-46a01bf05e9b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:38.981322 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9ff5fd82-634f-49b7-a493-46a01bf05e9b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:38.981780 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9ff5fd82-634f-49b7-a493-46a01bf05e9b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:38.982285 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9ff5fd82-634f-49b7-a493-46a01bf05e9b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:39.073520 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-fa6d337d-6b0c-4833-a9e5-fc80219f6a0f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:39.073743 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-9ff5fd82-634f-49b7-a493-46a01bf05e9b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:39.086726 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-9ff5fd82-634f-49b7-a493-46a01bf05e9b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1296 microversion: 2.1 time: 0.119597 Sep 01 16:36:39.087498 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 37/65] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:38 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1296 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:39.089123 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-fa6d337d-6b0c-4833-a9e5-fc80219f6a0f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:39.099459 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-fa6d337d-6b0c-4833-a9e5-fc80219f6a0f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:39.100847 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-fa6d337d-6b0c-4833-a9e5-fc80219f6a0f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1340 microversion: 2.20 time: 0.178100 Sep 01 16:36:39.102567 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7ba65398-4a9e-4bdf-8c00-909069d18961 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:39.103177 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-7ba65398-4a9e-4bdf-8c00-909069d18961 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: b16ceffd-c9b2-49e6-a44d-7353a17f230a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:39.109423 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7ba65398-4a9e-4bdf-8c00-909069d18961 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:39.110030 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7ba65398-4a9e-4bdf-8c00-909069d18961 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:39.110315 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7ba65398-4a9e-4bdf-8c00-909069d18961 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:39.111004 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7ba65398-4a9e-4bdf-8c00-909069d18961 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:39.111610 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7ba65398-4a9e-4bdf-8c00-909069d18961 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:39.112190 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7ba65398-4a9e-4bdf-8c00-909069d18961 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:39.126273 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 29/66] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:38 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1340 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:36:39.203355 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-7ba65398-4a9e-4bdf-8c00-909069d18961 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:39.212588 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-7ba65398-4a9e-4bdf-8c00-909069d18961 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a" status: 200 len: 1236 microversion: 2.1 time: 0.113959 Sep 01 16:36:39.213255 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 38/67] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:39 2022] GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a => generated 1236 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:39.706643 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3ac898fc-f8fa-47fe-b685-f14e18655909 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:39.706643 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-3ac898fc-f8fa-47fe-b685-f14e18655909 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:39.710700 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3ac898fc-f8fa-47fe-b685-f14e18655909 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:39.711198 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3ac898fc-f8fa-47fe-b685-f14e18655909 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:39.711635 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3ac898fc-f8fa-47fe-b685-f14e18655909 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:39.712359 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3ac898fc-f8fa-47fe-b685-f14e18655909 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:39.712819 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3ac898fc-f8fa-47fe-b685-f14e18655909 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:39.713354 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3ac898fc-f8fa-47fe-b685-f14e18655909 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:39.787117 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8ec8d575-81f6-441d-bb7b-e86546a026c2 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:39.787730 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-8ec8d575-81f6-441d-bb7b-e86546a026c2 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] [instance: 5bd544a7-a62e-434f-a842-e6231482d926] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:39.796425 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8ec8d575-81f6-441d-bb7b-e86546a026c2 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:39.802608 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8ec8d575-81f6-441d-bb7b-e86546a026c2 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:39.803077 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8ec8d575-81f6-441d-bb7b-e86546a026c2 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:39.803817 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8ec8d575-81f6-441d-bb7b-e86546a026c2 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:39.805775 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8ec8d575-81f6-441d-bb7b-e86546a026c2 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:39.806361 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8ec8d575-81f6-441d-bb7b-e86546a026c2 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:39.807872 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3ac898fc-f8fa-47fe-b685-f14e18655909 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:39.816830 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3ac898fc-f8fa-47fe-b685-f14e18655909 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1282 microversion: 2.1 time: 0.117345 Sep 01 16:36:39.817630 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 30/68] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:39 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1282 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:39.901080 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8ec8d575-81f6-441d-bb7b-e86546a026c2 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b1fea950d48ef9a55cded8ed172a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130966aabcc04fc98c9f5139f826e78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:39.910434 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8ec8d575-81f6-441d-bb7b-e86546a026c2 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] 10.222.0.62 "GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926" status: 200 len: 1272 microversion: 2.1 time: 0.127274 Sep 01 16:36:39.911006 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 39/69] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:39 2022] GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926 => generated 1272 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:40.110470 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-20cb3cfa-2203-4dbd-836c-e771f47b613b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:40.111490 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-20cb3cfa-2203-4dbd-836c-e771f47b613b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:40.119064 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-20cb3cfa-2203-4dbd-836c-e771f47b613b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:40.119878 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-20cb3cfa-2203-4dbd-836c-e771f47b613b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:40.119878 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-20cb3cfa-2203-4dbd-836c-e771f47b613b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:40.124007 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-20cb3cfa-2203-4dbd-836c-e771f47b613b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:40.124522 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-20cb3cfa-2203-4dbd-836c-e771f47b613b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:40.124956 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-20cb3cfa-2203-4dbd-836c-e771f47b613b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:40.140558 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-61a4f087-5fb2-4336-9a6d-457088889109 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:40.142718 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-61a4f087-5fb2-4336-9a6d-457088889109 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:40.147653 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:40.158985 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-61a4f087-5fb2-4336-9a6d-457088889109 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:40.159631 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-61a4f087-5fb2-4336-9a6d-457088889109 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:40.160289 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-61a4f087-5fb2-4336-9a6d-457088889109 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:40.161182 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-61a4f087-5fb2-4336-9a6d-457088889109 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:40.163526 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-61a4f087-5fb2-4336-9a6d-457088889109 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:40.164808 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-61a4f087-5fb2-4336-9a6d-457088889109 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:40.831136 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-61a4f087-5fb2-4336-9a6d-457088889109 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:40.843408 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-61a4f087-5fb2-4336-9a6d-457088889109 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:40.848092 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-61a4f087-5fb2-4336-9a6d-457088889109 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:40.849629 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-61a4f087-5fb2-4336-9a6d-457088889109 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1340 microversion: 2.20 time: 0.715162 Sep 01 16:36:40.870532 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 40/70] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:40 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1340 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:36:40.880668 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a19a5604-d61a-4662-b35e-e2eb6ca4a780 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:40.882301 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-a19a5604-d61a-4662-b35e-e2eb6ca4a780 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: b16ceffd-c9b2-49e6-a44d-7353a17f230a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:40.898790 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a19a5604-d61a-4662-b35e-e2eb6ca4a780 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:40.901717 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a19a5604-d61a-4662-b35e-e2eb6ca4a780 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:40.903540 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a19a5604-d61a-4662-b35e-e2eb6ca4a780 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:40.904638 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a19a5604-d61a-4662-b35e-e2eb6ca4a780 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:40.909495 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a19a5604-d61a-4662-b35e-e2eb6ca4a780 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:40.910134 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a19a5604-d61a-4662-b35e-e2eb6ca4a780 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:40.942601 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-20cb3cfa-2203-4dbd-836c-e771f47b613b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:40.960413 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-20cb3cfa-2203-4dbd-836c-e771f47b613b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1296 microversion: 2.1 time: 0.854825 Sep 01 16:36:40.963613 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 31/71] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:40 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1296 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:41.014386 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-38aa5c2b-9bed-4635-bc13-baf6592030cc tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:41.015938 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-38aa5c2b-9bed-4635-bc13-baf6592030cc tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:41.041373 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-38aa5c2b-9bed-4635-bc13-baf6592030cc tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:41.042325 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-38aa5c2b-9bed-4635-bc13-baf6592030cc tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:41.043206 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-38aa5c2b-9bed-4635-bc13-baf6592030cc tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:41.045169 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-38aa5c2b-9bed-4635-bc13-baf6592030cc tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:41.048930 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-38aa5c2b-9bed-4635-bc13-baf6592030cc tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:41.049696 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-38aa5c2b-9bed-4635-bc13-baf6592030cc tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:41.253447 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-a19a5604-d61a-4662-b35e-e2eb6ca4a780 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:41.287191 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-a19a5604-d61a-4662-b35e-e2eb6ca4a780 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a" status: 200 len: 1292 microversion: 2.1 time: 0.416168 Sep 01 16:36:41.290709 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 41/72] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:40 2022] GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a => generated 1292 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:41.305630 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-71e9a03c-8ce4-4cba-a346-498cfb0a0a0a tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:41.306552 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-71e9a03c-8ce4-4cba-a346-498cfb0a0a0a tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] [instance: 5bd544a7-a62e-434f-a842-e6231482d926] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:41.316305 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-71e9a03c-8ce4-4cba-a346-498cfb0a0a0a tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:41.317097 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-71e9a03c-8ce4-4cba-a346-498cfb0a0a0a tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:41.317911 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-71e9a03c-8ce4-4cba-a346-498cfb0a0a0a tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:41.318869 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-71e9a03c-8ce4-4cba-a346-498cfb0a0a0a tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:41.319489 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-71e9a03c-8ce4-4cba-a346-498cfb0a0a0a tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:41.320517 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-71e9a03c-8ce4-4cba-a346-498cfb0a0a0a tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:41.728744 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-71e9a03c-8ce4-4cba-a346-498cfb0a0a0a tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b1fea950d48ef9a55cded8ed172a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130966aabcc04fc98c9f5139f826e78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:41.737167 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-71e9a03c-8ce4-4cba-a346-498cfb0a0a0a tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] 10.222.0.62 "GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926" status: 200 len: 1272 microversion: 2.1 time: 0.444722 Sep 01 16:36:41.738026 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 42/73] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:41 2022] GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926 => generated 1272 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:41.783866 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-38aa5c2b-9bed-4635-bc13-baf6592030cc tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:41.799155 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-38aa5c2b-9bed-4635-bc13-baf6592030cc tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1280 microversion: 2.1 time: 0.827703 Sep 01 16:36:41.802513 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 32/74] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:40 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1280 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:41.875128 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-df89dd56-a18f-4d0b-8a40-5626e2a57de1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:41.876119 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-df89dd56-a18f-4d0b-8a40-5626e2a57de1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:41.898710 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-df89dd56-a18f-4d0b-8a40-5626e2a57de1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:41.899382 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-df89dd56-a18f-4d0b-8a40-5626e2a57de1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:41.899949 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-df89dd56-a18f-4d0b-8a40-5626e2a57de1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:41.900785 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-df89dd56-a18f-4d0b-8a40-5626e2a57de1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:41.910305 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-df89dd56-a18f-4d0b-8a40-5626e2a57de1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:41.915018 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-df89dd56-a18f-4d0b-8a40-5626e2a57de1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:41.995839 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0a1ab700-93a9-426b-a3a6-10e78a8bb80e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:42.008992 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0a1ab700-93a9-426b-a3a6-10e78a8bb80e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:42.014779 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:42.043589 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0a1ab700-93a9-426b-a3a6-10e78a8bb80e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:42.043589 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0a1ab700-93a9-426b-a3a6-10e78a8bb80e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:42.043589 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0a1ab700-93a9-426b-a3a6-10e78a8bb80e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:42.043589 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0a1ab700-93a9-426b-a3a6-10e78a8bb80e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:42.044405 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0a1ab700-93a9-426b-a3a6-10e78a8bb80e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:42.044405 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0a1ab700-93a9-426b-a3a6-10e78a8bb80e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:42.262298 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-df89dd56-a18f-4d0b-8a40-5626e2a57de1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:42.282387 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-df89dd56-a18f-4d0b-8a40-5626e2a57de1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:42.294935 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-df89dd56-a18f-4d0b-8a40-5626e2a57de1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:42.305501 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-df89dd56-a18f-4d0b-8a40-5626e2a57de1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1340 microversion: 2.20 time: 0.435547 Sep 01 16:36:42.308601 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 43/75] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:41 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1340 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:36:42.326378 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-9679ceb5-3d10-4975-af4a-231cdb12e59b tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:42.338157 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-9679ceb5-3d10-4975-af4a-231cdb12e59b tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: b16ceffd-c9b2-49e6-a44d-7353a17f230a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:42.370349 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9679ceb5-3d10-4975-af4a-231cdb12e59b tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:42.371775 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9679ceb5-3d10-4975-af4a-231cdb12e59b tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:42.377362 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9679ceb5-3d10-4975-af4a-231cdb12e59b tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:42.384139 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9679ceb5-3d10-4975-af4a-231cdb12e59b tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:42.388771 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9679ceb5-3d10-4975-af4a-231cdb12e59b tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:42.390182 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9679ceb5-3d10-4975-af4a-231cdb12e59b tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:42.453059 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0a1ab700-93a9-426b-a3a6-10e78a8bb80e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:42.466222 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0a1ab700-93a9-426b-a3a6-10e78a8bb80e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1294 microversion: 2.1 time: 0.475094 Sep 01 16:36:42.467156 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 33/76] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:41 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1294 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:42.760486 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2ff09f23-37ad-44bb-925d-0636cc70f460 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:42.762422 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-2ff09f23-37ad-44bb-925d-0636cc70f460 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] [instance: 5bd544a7-a62e-434f-a842-e6231482d926] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:42.776888 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2ff09f23-37ad-44bb-925d-0636cc70f460 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:42.779581 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-9679ceb5-3d10-4975-af4a-231cdb12e59b tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:42.780388 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2ff09f23-37ad-44bb-925d-0636cc70f460 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:42.781539 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2ff09f23-37ad-44bb-925d-0636cc70f460 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:42.785364 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2ff09f23-37ad-44bb-925d-0636cc70f460 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:42.787041 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2ff09f23-37ad-44bb-925d-0636cc70f460 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:42.789577 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2ff09f23-37ad-44bb-925d-0636cc70f460 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:42.790051 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-9679ceb5-3d10-4975-af4a-231cdb12e59b tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a" status: 200 len: 1298 microversion: 2.1 time: 0.478716 Sep 01 16:36:42.791237 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 44/77] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:42 2022] GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a => generated 1298 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:42.835605 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e5e65bbb-79ad-48b1-b1da-3debea48ea56 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:42.843115 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e5e65bbb-79ad-48b1-b1da-3debea48ea56 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:42.869529 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e5e65bbb-79ad-48b1-b1da-3debea48ea56 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:42.871641 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e5e65bbb-79ad-48b1-b1da-3debea48ea56 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:42.874070 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e5e65bbb-79ad-48b1-b1da-3debea48ea56 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:42.876164 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e5e65bbb-79ad-48b1-b1da-3debea48ea56 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:42.877169 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e5e65bbb-79ad-48b1-b1da-3debea48ea56 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:42.878344 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e5e65bbb-79ad-48b1-b1da-3debea48ea56 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:43.353821 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2ff09f23-37ad-44bb-925d-0636cc70f460 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b1fea950d48ef9a55cded8ed172a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130966aabcc04fc98c9f5139f826e78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:43.373697 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2ff09f23-37ad-44bb-925d-0636cc70f460 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] 10.222.0.62 "GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926" status: 200 len: 1272 microversion: 2.1 time: 0.618328 Sep 01 16:36:43.392209 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 34/78] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:42 2022] GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926 => generated 1272 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:43.406128 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3c5ce165-5da5-49ef-9091-718ae84180c4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:43.410795 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-3c5ce165-5da5-49ef-9091-718ae84180c4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:43.445341 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3c5ce165-5da5-49ef-9091-718ae84180c4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:43.449963 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3c5ce165-5da5-49ef-9091-718ae84180c4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:43.450815 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3c5ce165-5da5-49ef-9091-718ae84180c4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:43.458706 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3c5ce165-5da5-49ef-9091-718ae84180c4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:43.460620 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-e5e65bbb-79ad-48b1-b1da-3debea48ea56 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:43.464316 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3c5ce165-5da5-49ef-9091-718ae84180c4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:43.466253 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3c5ce165-5da5-49ef-9091-718ae84180c4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:43.480262 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e5e65bbb-79ad-48b1-b1da-3debea48ea56 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1280 microversion: 2.1 time: 0.657285 Sep 01 16:36:43.496888 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 45/79] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:42 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1280 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:43.502989 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-066556db-d55e-4805-a552-ac5246d56823 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:43.504018 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-066556db-d55e-4805-a552-ac5246d56823 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:43.515804 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-066556db-d55e-4805-a552-ac5246d56823 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:43.517252 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-066556db-d55e-4805-a552-ac5246d56823 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:43.521500 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-066556db-d55e-4805-a552-ac5246d56823 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:43.524383 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-066556db-d55e-4805-a552-ac5246d56823 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:43.524383 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-066556db-d55e-4805-a552-ac5246d56823 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:43.524383 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-066556db-d55e-4805-a552-ac5246d56823 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:43.567550 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=4 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:43.958336 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3c5ce165-5da5-49ef-9091-718ae84180c4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:43.974066 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3c5ce165-5da5-49ef-9091-718ae84180c4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:43.977505 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3c5ce165-5da5-49ef-9091-718ae84180c4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:43.978888 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3c5ce165-5da5-49ef-9091-718ae84180c4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1340 microversion: 2.20 time: 0.585405 Sep 01 16:36:43.983773 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 35/80] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:43 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1340 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:36:44.001744 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5630a16f-eb10-4526-9b79-e15b4dd6340c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:44.010802 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5630a16f-eb10-4526-9b79-e15b4dd6340c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: b16ceffd-c9b2-49e6-a44d-7353a17f230a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:44.021608 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-066556db-d55e-4805-a552-ac5246d56823 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:44.027876 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=100 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:44.037839 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5630a16f-eb10-4526-9b79-e15b4dd6340c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:44.038355 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5630a16f-eb10-4526-9b79-e15b4dd6340c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:44.038821 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5630a16f-eb10-4526-9b79-e15b4dd6340c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:44.039530 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5630a16f-eb10-4526-9b79-e15b4dd6340c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:44.040076 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5630a16f-eb10-4526-9b79-e15b4dd6340c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:44.040500 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5630a16f-eb10-4526-9b79-e15b4dd6340c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:44.044824 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-066556db-d55e-4805-a552-ac5246d56823 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1294 microversion: 2.1 time: 0.546325 Sep 01 16:36:44.084644 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 46/81] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:43 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1294 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:44.401695 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ac5746b9-ca6b-4808-b848-350977f02b50 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:44.402479 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ac5746b9-ca6b-4808-b848-350977f02b50 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] [instance: 5bd544a7-a62e-434f-a842-e6231482d926] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:44.405416 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=28 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:44.433301 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac5746b9-ca6b-4808-b848-350977f02b50 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:44.433904 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac5746b9-ca6b-4808-b848-350977f02b50 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:44.442752 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac5746b9-ca6b-4808-b848-350977f02b50 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:44.446375 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac5746b9-ca6b-4808-b848-350977f02b50 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:44.446926 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac5746b9-ca6b-4808-b848-350977f02b50 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:44.447360 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac5746b9-ca6b-4808-b848-350977f02b50 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:44.450083 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5630a16f-eb10-4526-9b79-e15b4dd6340c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:44.466321 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5630a16f-eb10-4526-9b79-e15b4dd6340c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a" status: 200 len: 1298 microversion: 2.1 time: 0.478793 Sep 01 16:36:44.483104 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 36/82] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:43 2022] GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a => generated 1298 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:44.508365 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-aa139bfb-ec6c-463a-89fd-9a70fc17fbdd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:44.509260 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-aa139bfb-ec6c-463a-89fd-9a70fc17fbdd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:44.520068 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-aa139bfb-ec6c-463a-89fd-9a70fc17fbdd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:44.520621 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-aa139bfb-ec6c-463a-89fd-9a70fc17fbdd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:44.528682 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-aa139bfb-ec6c-463a-89fd-9a70fc17fbdd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:44.529429 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-aa139bfb-ec6c-463a-89fd-9a70fc17fbdd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:44.530633 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-aa139bfb-ec6c-463a-89fd-9a70fc17fbdd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:44.531125 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-aa139bfb-ec6c-463a-89fd-9a70fc17fbdd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:44.893833 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-aa139bfb-ec6c-463a-89fd-9a70fc17fbdd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:44.914759 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-aa139bfb-ec6c-463a-89fd-9a70fc17fbdd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1280 microversion: 2.1 time: 0.410646 Sep 01 16:36:44.930125 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 37/83] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:44 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1280 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:45.014307 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-41154617-2881-4231-9a4a-bc6d1bad46e6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:45.014940 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-41154617-2881-4231-9a4a-bc6d1bad46e6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:45.025749 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-41154617-2881-4231-9a4a-bc6d1bad46e6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:45.026271 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-41154617-2881-4231-9a4a-bc6d1bad46e6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:45.026712 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-41154617-2881-4231-9a4a-bc6d1bad46e6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:45.027534 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-41154617-2881-4231-9a4a-bc6d1bad46e6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:45.032584 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-41154617-2881-4231-9a4a-bc6d1bad46e6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:45.033026 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-41154617-2881-4231-9a4a-bc6d1bad46e6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:45.037399 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=100 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:45.247733 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-41154617-2881-4231-9a4a-bc6d1bad46e6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:45.258225 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-41154617-2881-4231-9a4a-bc6d1bad46e6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:45.260377 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-41154617-2881-4231-9a4a-bc6d1bad46e6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:45.263124 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-41154617-2881-4231-9a4a-bc6d1bad46e6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1340 microversion: 2.20 time: 0.252648 Sep 01 16:36:45.265108 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 38/84] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:45 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1340 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:36:45.272509 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8264d057-e554-4ce0-b047-597487adbd62 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:45.273331 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8264d057-e554-4ce0-b047-597487adbd62 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:45.280659 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8264d057-e554-4ce0-b047-597487adbd62 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:45.281337 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8264d057-e554-4ce0-b047-597487adbd62 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:45.281984 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8264d057-e554-4ce0-b047-597487adbd62 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:45.282851 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8264d057-e554-4ce0-b047-597487adbd62 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:45.283423 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8264d057-e554-4ce0-b047-597487adbd62 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:45.283968 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8264d057-e554-4ce0-b047-597487adbd62 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:45.408552 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ac5746b9-ca6b-4808-b848-350977f02b50 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b1fea950d48ef9a55cded8ed172a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130966aabcc04fc98c9f5139f826e78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:45.421827 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ac5746b9-ca6b-4808-b848-350977f02b50 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] 10.222.0.62 "GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926" status: 200 len: 1314 microversion: 2.1 time: 1.026690 Sep 01 16:36:45.422491 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 47/85] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:44 2022] GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926 => generated 1314 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:45.452842 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=8 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:45.483487 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8264d057-e554-4ce0-b047-597487adbd62 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:45.492897 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-94463248-f1b7-4cc3-9b0a-d92355b52a8f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:45.493124 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8264d057-e554-4ce0-b047-597487adbd62 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1294 microversion: 2.1 time: 0.226359 Sep 01 16:36:45.494272 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-94463248-f1b7-4cc3-9b0a-d92355b52a8f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: b16ceffd-c9b2-49e6-a44d-7353a17f230a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:45.502329 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-94463248-f1b7-4cc3-9b0a-d92355b52a8f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:45.502946 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-94463248-f1b7-4cc3-9b0a-d92355b52a8f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:45.503470 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-94463248-f1b7-4cc3-9b0a-d92355b52a8f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:45.504412 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-94463248-f1b7-4cc3-9b0a-d92355b52a8f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:45.505084 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 39/86] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:45 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1294 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:45.505210 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-94463248-f1b7-4cc3-9b0a-d92355b52a8f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:45.506630 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-94463248-f1b7-4cc3-9b0a-d92355b52a8f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:45.866253 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-94463248-f1b7-4cc3-9b0a-d92355b52a8f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:45.874798 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-94463248-f1b7-4cc3-9b0a-d92355b52a8f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a" status: 200 len: 1298 microversion: 2.1 time: 0.386363 Sep 01 16:36:45.876013 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 48/87] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:45 2022] GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a => generated 1298 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:45.942218 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-4c0c8c58-6120-4574-b3ca-cab38f7b6ad9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:45.942833 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-4c0c8c58-6120-4574-b3ca-cab38f7b6ad9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:45.950574 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4c0c8c58-6120-4574-b3ca-cab38f7b6ad9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:45.951488 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4c0c8c58-6120-4574-b3ca-cab38f7b6ad9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:45.952235 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4c0c8c58-6120-4574-b3ca-cab38f7b6ad9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:45.952960 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4c0c8c58-6120-4574-b3ca-cab38f7b6ad9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:45.954013 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4c0c8c58-6120-4574-b3ca-cab38f7b6ad9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:45.954424 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4c0c8c58-6120-4574-b3ca-cab38f7b6ad9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:46.084419 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-4c0c8c58-6120-4574-b3ca-cab38f7b6ad9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:46.094323 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-4c0c8c58-6120-4574-b3ca-cab38f7b6ad9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1280 microversion: 2.1 time: 0.155798 Sep 01 16:36:46.094984 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 40/88] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:45 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1280 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:46.292081 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ff93de2b-b710-4b92-a0da-8b36071789ef tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:46.293423 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ff93de2b-b710-4b92-a0da-8b36071789ef tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:46.304650 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ff93de2b-b710-4b92-a0da-8b36071789ef tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:46.305947 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ff93de2b-b710-4b92-a0da-8b36071789ef tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:46.306612 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ff93de2b-b710-4b92-a0da-8b36071789ef tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:46.308054 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ff93de2b-b710-4b92-a0da-8b36071789ef tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:46.308860 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ff93de2b-b710-4b92-a0da-8b36071789ef tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:46.310127 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ff93de2b-b710-4b92-a0da-8b36071789ef tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:46.442669 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8ff504d7-242a-40f5-9468-d351ede00fad tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:46.443670 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8ff504d7-242a-40f5-9468-d351ede00fad tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] [instance: 5bd544a7-a62e-434f-a842-e6231482d926] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:46.458395 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=30 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:46.471014 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8ff504d7-242a-40f5-9468-d351ede00fad tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:46.487143 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8ff504d7-242a-40f5-9468-d351ede00fad tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:46.487605 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8ff504d7-242a-40f5-9468-d351ede00fad tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:46.488386 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8ff504d7-242a-40f5-9468-d351ede00fad tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:46.489347 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8ff504d7-242a-40f5-9468-d351ede00fad tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:46.490071 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8ff504d7-242a-40f5-9468-d351ede00fad tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:46.988287 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ff93de2b-b710-4b92-a0da-8b36071789ef tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:46.999112 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ff93de2b-b710-4b92-a0da-8b36071789ef tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:47.000629 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ff93de2b-b710-4b92-a0da-8b36071789ef tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:47.003798 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ff93de2b-b710-4b92-a0da-8b36071789ef tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1407 microversion: 2.20 time: 0.714746 Sep 01 16:36:47.005647 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 49/89] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:46 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1407 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:36:47.019311 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8ff504d7-242a-40f5-9468-d351ede00fad tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b1fea950d48ef9a55cded8ed172a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130966aabcc04fc98c9f5139f826e78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:47.035686 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8ff504d7-242a-40f5-9468-d351ede00fad tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] 10.222.0.62 "GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926" status: 200 len: 1314 microversion: 2.1 time: 0.596082 Sep 01 16:36:47.038817 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 41/90] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:46 2022] GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926 => generated 1314 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:47.046213 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a2550444-98e0-4028-9af9-9f4b68c4296e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:47.046213 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-a2550444-98e0-4028-9af9-9f4b68c4296e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:47.061889 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5040142a-670d-435f-a542-f78b4a9ebed9 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:47.062532 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5040142a-670d-435f-a542-f78b4a9ebed9 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: b16ceffd-c9b2-49e6-a44d-7353a17f230a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:47.069489 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5040142a-670d-435f-a542-f78b4a9ebed9 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:47.070148 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5040142a-670d-435f-a542-f78b4a9ebed9 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:47.070840 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5040142a-670d-435f-a542-f78b4a9ebed9 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:47.071841 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5040142a-670d-435f-a542-f78b4a9ebed9 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:47.072546 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5040142a-670d-435f-a542-f78b4a9ebed9 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:47.073177 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5040142a-670d-435f-a542-f78b4a9ebed9 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:47.075768 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a2550444-98e0-4028-9af9-9f4b68c4296e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:47.076835 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a2550444-98e0-4028-9af9-9f4b68c4296e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:47.080653 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a2550444-98e0-4028-9af9-9f4b68c4296e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:47.081625 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a2550444-98e0-4028-9af9-9f4b68c4296e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:47.082155 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a2550444-98e0-4028-9af9-9f4b68c4296e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:47.082582 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a2550444-98e0-4028-9af9-9f4b68c4296e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:47.465622 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-a2550444-98e0-4028-9af9-9f4b68c4296e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:47.483419 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5040142a-670d-435f-a542-f78b4a9ebed9 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:47.485449 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-a2550444-98e0-4028-9af9-9f4b68c4296e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1360 microversion: 2.1 time: 0.478226 Sep 01 16:36:47.486161 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 50/91] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:47 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1360 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:47.493448 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-1adf2bd7-3546-4cd0-b035-e7e9bc1181a8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:47.494329 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5040142a-670d-435f-a542-f78b4a9ebed9 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a" status: 200 len: 1366 microversion: 2.1 time: 0.446542 Sep 01 16:36:47.495452 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-1adf2bd7-3546-4cd0-b035-e7e9bc1181a8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:47.495954 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 42/92] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:47 2022] GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a => generated 1366 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:47.502303 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1adf2bd7-3546-4cd0-b035-e7e9bc1181a8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:47.502784 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1adf2bd7-3546-4cd0-b035-e7e9bc1181a8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:47.503476 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1adf2bd7-3546-4cd0-b035-e7e9bc1181a8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:47.503874 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1adf2bd7-3546-4cd0-b035-e7e9bc1181a8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:47.506207 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1adf2bd7-3546-4cd0-b035-e7e9bc1181a8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:47.512761 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1adf2bd7-3546-4cd0-b035-e7e9bc1181a8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:47.907878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-1adf2bd7-3546-4cd0-b035-e7e9bc1181a8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:47.921008 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-1adf2bd7-3546-4cd0-b035-e7e9bc1181a8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1322 microversion: 2.1 time: 0.433219 Sep 01 16:36:47.922672 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 51/93] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:47 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1322 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:48.036370 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-698d4b5e-a381-4e14-acb9-446468a96873 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:48.037026 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-698d4b5e-a381-4e14-acb9-446468a96873 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:48.046657 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-698d4b5e-a381-4e14-acb9-446468a96873 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:48.063983 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-698d4b5e-a381-4e14-acb9-446468a96873 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:48.064453 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-698d4b5e-a381-4e14-acb9-446468a96873 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:48.065271 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-698d4b5e-a381-4e14-acb9-446468a96873 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:48.065738 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-698d4b5e-a381-4e14-acb9-446468a96873 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:48.066165 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-698d4b5e-a381-4e14-acb9-446468a96873 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:48.066334 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-9b4670ea-8883-4445-85ad-7f44df645f0d tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:48.067515 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-9b4670ea-8883-4445-85ad-7f44df645f0d tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] [instance: 5bd544a7-a62e-434f-a842-e6231482d926] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:48.074637 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9b4670ea-8883-4445-85ad-7f44df645f0d tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:48.077182 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9b4670ea-8883-4445-85ad-7f44df645f0d tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:48.079520 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9b4670ea-8883-4445-85ad-7f44df645f0d tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:48.083644 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9b4670ea-8883-4445-85ad-7f44df645f0d tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:48.084450 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9b4670ea-8883-4445-85ad-7f44df645f0d tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:48.084883 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9b4670ea-8883-4445-85ad-7f44df645f0d tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:49.455523 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-9b4670ea-8883-4445-85ad-7f44df645f0d tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b1fea950d48ef9a55cded8ed172a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130966aabcc04fc98c9f5139f826e78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:49.476028 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-9b4670ea-8883-4445-85ad-7f44df645f0d tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] 10.222.0.62 "GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926" status: 200 len: 1314 microversion: 2.1 time: 1.407705 Sep 01 16:36:49.478693 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 52/94] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:48 2022] GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926 => generated 1314 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:49.496834 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-22af18f3-de02-4461-bf9b-063708ba0189 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:49.499949 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-22af18f3-de02-4461-bf9b-063708ba0189 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:49.518664 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-22af18f3-de02-4461-bf9b-063708ba0189 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:49.519344 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-22af18f3-de02-4461-bf9b-063708ba0189 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:49.520083 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-22af18f3-de02-4461-bf9b-063708ba0189 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:49.520897 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-22af18f3-de02-4461-bf9b-063708ba0189 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:49.521913 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-22af18f3-de02-4461-bf9b-063708ba0189 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:49.523552 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-22af18f3-de02-4461-bf9b-063708ba0189 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:49.900832 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-698d4b5e-a381-4e14-acb9-446468a96873 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:49.920052 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-698d4b5e-a381-4e14-acb9-446468a96873 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:49.927499 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-698d4b5e-a381-4e14-acb9-446468a96873 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:49.932529 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-698d4b5e-a381-4e14-acb9-446468a96873 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1407 microversion: 2.20 time: 1.900354 Sep 01 16:36:49.937982 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 43/95] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:48 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1407 bytes in 1906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:36:49.956337 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f3db303d-cf5b-4712-8460-78230b83cdab tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:49.957223 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f3db303d-cf5b-4712-8460-78230b83cdab tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: b16ceffd-c9b2-49e6-a44d-7353a17f230a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:49.963978 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f3db303d-cf5b-4712-8460-78230b83cdab tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:49.964824 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f3db303d-cf5b-4712-8460-78230b83cdab tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:49.965486 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f3db303d-cf5b-4712-8460-78230b83cdab tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:49.977008 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f3db303d-cf5b-4712-8460-78230b83cdab tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:49.977734 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f3db303d-cf5b-4712-8460-78230b83cdab tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:49.978300 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f3db303d-cf5b-4712-8460-78230b83cdab tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:50.613758 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f3db303d-cf5b-4712-8460-78230b83cdab tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:50.622240 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f3db303d-cf5b-4712-8460-78230b83cdab tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a" status: 200 len: 1366 microversion: 2.1 time: 0.682907 Sep 01 16:36:50.636462 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 44/96] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:49 2022] GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a => generated 1366 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:50.642503 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ee2126fe-9748-478f-aa02-367f4f65f897 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:50.643336 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ee2126fe-9748-478f-aa02-367f4f65f897 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:50.653654 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ee2126fe-9748-478f-aa02-367f4f65f897 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:50.654379 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ee2126fe-9748-478f-aa02-367f4f65f897 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:50.654956 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ee2126fe-9748-478f-aa02-367f4f65f897 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:50.660853 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ee2126fe-9748-478f-aa02-367f4f65f897 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:50.661601 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ee2126fe-9748-478f-aa02-367f4f65f897 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:50.662202 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ee2126fe-9748-478f-aa02-367f4f65f897 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:50.883876 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-22af18f3-de02-4461-bf9b-063708ba0189 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:50.900599 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-22af18f3-de02-4461-bf9b-063708ba0189 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1360 microversion: 2.1 time: 1.418494 Sep 01 16:36:50.902261 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 53/97] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:49 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1360 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:50.909871 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-bb5070dc-aedb-4505-a313-c150edb8802f tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:50.911015 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-bb5070dc-aedb-4505-a313-c150edb8802f tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] [instance: 5bd544a7-a62e-434f-a842-e6231482d926] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:50.919995 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bb5070dc-aedb-4505-a313-c150edb8802f tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:50.920585 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bb5070dc-aedb-4505-a313-c150edb8802f tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:50.921135 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bb5070dc-aedb-4505-a313-c150edb8802f tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:50.923593 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bb5070dc-aedb-4505-a313-c150edb8802f tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:50.924422 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bb5070dc-aedb-4505-a313-c150edb8802f tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:50.925024 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bb5070dc-aedb-4505-a313-c150edb8802f tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:51.462450 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ee2126fe-9748-478f-aa02-367f4f65f897 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:51.471212 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ee2126fe-9748-478f-aa02-367f4f65f897 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1322 microversion: 2.1 time: 0.833255 Sep 01 16:36:51.495963 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 45/98] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:50 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1322 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:51.608049 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-bb5070dc-aedb-4505-a313-c150edb8802f tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b1fea950d48ef9a55cded8ed172a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130966aabcc04fc98c9f5139f826e78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:51.618789 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-bb5070dc-aedb-4505-a313-c150edb8802f tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] 10.222.0.62 "GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926" status: 200 len: 1314 microversion: 2.1 time: 0.714673 Sep 01 16:36:51.620633 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 54/99] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:50 2022] GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926 => generated 1314 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:51.647409 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-790f47c5-46c5-4853-b01d-db4715b84572 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:51.650294 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-790f47c5-46c5-4853-b01d-db4715b84572 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:51.665367 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-790f47c5-46c5-4853-b01d-db4715b84572 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:51.665887 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-790f47c5-46c5-4853-b01d-db4715b84572 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:51.666319 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-790f47c5-46c5-4853-b01d-db4715b84572 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:51.667025 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-790f47c5-46c5-4853-b01d-db4715b84572 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:51.667513 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-790f47c5-46c5-4853-b01d-db4715b84572 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:51.668035 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-790f47c5-46c5-4853-b01d-db4715b84572 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:52.161956 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-25c99828-61f3-4443-83a9-7aebb4ab17aa req-f34a5ad8-26ac-4cab-b03b-8edd148eab77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5537b019-c314-4b22-bde4-b19b3641c648", "tag": "63af1365-37ee-4010-8c55-df1561b93a9a"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:52.183518 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-25c99828-61f3-4443-83a9-7aebb4ab17aa req-f34a5ad8-26ac-4cab-b03b-8edd148eab77 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:52.184566 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-25c99828-61f3-4443-83a9-7aebb4ab17aa req-f34a5ad8-26ac-4cab-b03b-8edd148eab77 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:52.185977 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-25c99828-61f3-4443-83a9-7aebb4ab17aa req-f34a5ad8-26ac-4cab-b03b-8edd148eab77 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:52.274971 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-25c99828-61f3-4443-83a9-7aebb4ab17aa req-f34a5ad8-26ac-4cab-b03b-8edd148eab77 service nova] Creating event network-changed:63af1365-37ee-4010-8c55-df1561b93a9a for instance 5537b019-c314-4b22-bde4-b19b3641c648 on hv-cinder-85221 Sep 01 16:36:52.277404 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-25c99828-61f3-4443-83a9-7aebb4ab17aa req-f34a5ad8-26ac-4cab-b03b-8edd148eab77 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127198) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 16:36:52.279857 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-25c99828-61f3-4443-83a9-7aebb4ab17aa req-f34a5ad8-26ac-4cab-b03b-8edd148eab77 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127198) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 16:36:52.281873 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-794e389f-689a-4868-90b6-0956aa23e203 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:52.282734 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-794e389f-689a-4868-90b6-0956aa23e203 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:52.283377 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-794e389f-689a-4868-90b6-0956aa23e203 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:52.293751 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-794e389f-689a-4868-90b6-0956aa23e203 None None] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:52.294651 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-794e389f-689a-4868-90b6-0956aa23e203 None None] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:52.300457 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-794e389f-689a-4868-90b6-0956aa23e203 None None] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:52.314570 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.compute.rpcapi [None req-794e389f-689a-4868-90b6-0956aa23e203 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 01 16:36:52.315835 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-794e389f-689a-4868-90b6-0956aa23e203 None None] Releasing lock "compute-rpcapi-router" {{(pid=127198) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 16:36:52.338227 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-794e389f-689a-4868-90b6-0956aa23e203 None None] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.840516 Sep 01 16:36:52.340036 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 46/100] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:36:52.356430 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-263a2cb0-530c-45b5-9973-04d2e52911c8 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:52.357687 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-263a2cb0-530c-45b5-9973-04d2e52911c8 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: b16ceffd-c9b2-49e6-a44d-7353a17f230a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:52.365710 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-263a2cb0-530c-45b5-9973-04d2e52911c8 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:52.366767 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-263a2cb0-530c-45b5-9973-04d2e52911c8 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:52.367540 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-263a2cb0-530c-45b5-9973-04d2e52911c8 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:52.368569 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-263a2cb0-530c-45b5-9973-04d2e52911c8 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:52.369263 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-263a2cb0-530c-45b5-9973-04d2e52911c8 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:52.370029 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-263a2cb0-530c-45b5-9973-04d2e52911c8 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:52.638467 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-790f47c5-46c5-4853-b01d-db4715b84572 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:52.652660 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-790f47c5-46c5-4853-b01d-db4715b84572 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:52.662263 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-790f47c5-46c5-4853-b01d-db4715b84572 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:52.663450 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-790f47c5-46c5-4853-b01d-db4715b84572 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1407 microversion: 2.20 time: 1.040940 Sep 01 16:36:52.664899 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 55/101] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:51 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1407 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:36:52.675536 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-fbab6f9c-1ae1-4d57-ad81-0e298d5234b6 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:52.676194 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-fbab6f9c-1ae1-4d57-ad81-0e298d5234b6 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:52.709746 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fbab6f9c-1ae1-4d57-ad81-0e298d5234b6 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:52.710235 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fbab6f9c-1ae1-4d57-ad81-0e298d5234b6 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:52.713512 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fbab6f9c-1ae1-4d57-ad81-0e298d5234b6 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:52.714583 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fbab6f9c-1ae1-4d57-ad81-0e298d5234b6 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:52.715426 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fbab6f9c-1ae1-4d57-ad81-0e298d5234b6 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:52.716019 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fbab6f9c-1ae1-4d57-ad81-0e298d5234b6 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:53.411055 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-fbab6f9c-1ae1-4d57-ad81-0e298d5234b6 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:53.431020 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-fbab6f9c-1ae1-4d57-ad81-0e298d5234b6 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1360 microversion: 2.1 time: 0.764817 Sep 01 16:36:53.431760 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 56/102] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:52 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1360 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:53.438438 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-1f9c138f-a1fa-415f-a3b1-b7feeb480957 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:53.441441 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-1f9c138f-a1fa-415f-a3b1-b7feeb480957 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:53.456601 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1f9c138f-a1fa-415f-a3b1-b7feeb480957 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:53.458391 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1f9c138f-a1fa-415f-a3b1-b7feeb480957 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:53.460082 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1f9c138f-a1fa-415f-a3b1-b7feeb480957 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:53.469749 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1f9c138f-a1fa-415f-a3b1-b7feeb480957 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:53.470417 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1f9c138f-a1fa-415f-a3b1-b7feeb480957 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:53.471043 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1f9c138f-a1fa-415f-a3b1-b7feeb480957 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:53.471871 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-263a2cb0-530c-45b5-9973-04d2e52911c8 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:53.483728 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-263a2cb0-530c-45b5-9973-04d2e52911c8 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a" status: 200 len: 1366 microversion: 2.1 time: 1.141145 Sep 01 16:36:53.485093 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 47/103] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:52 2022] GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a => generated 1366 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:53.493955 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2a840ff2-a67d-40ce-8f46-2787b08fa240 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:53.494569 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-2a840ff2-a67d-40ce-8f46-2787b08fa240 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] [instance: 5bd544a7-a62e-434f-a842-e6231482d926] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:53.514620 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2a840ff2-a67d-40ce-8f46-2787b08fa240 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:53.517659 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2a840ff2-a67d-40ce-8f46-2787b08fa240 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:53.519486 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2a840ff2-a67d-40ce-8f46-2787b08fa240 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:53.521729 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2a840ff2-a67d-40ce-8f46-2787b08fa240 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:53.523608 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2a840ff2-a67d-40ce-8f46-2787b08fa240 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:53.524082 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2a840ff2-a67d-40ce-8f46-2787b08fa240 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:53.846867 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-1f9c138f-a1fa-415f-a3b1-b7feeb480957 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:53.860767 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-1f9c138f-a1fa-415f-a3b1-b7feeb480957 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1322 microversion: 2.1 time: 0.426647 Sep 01 16:36:53.862561 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 57/104] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:53 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1322 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:53.949488 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2a840ff2-a67d-40ce-8f46-2787b08fa240 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b1fea950d48ef9a55cded8ed172a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130966aabcc04fc98c9f5139f826e78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:53.959804 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2a840ff2-a67d-40ce-8f46-2787b08fa240 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] 10.222.0.62 "GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926" status: 200 len: 1314 microversion: 2.1 time: 0.473480 Sep 01 16:36:53.962399 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 48/105] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:53 2022] GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926 => generated 1314 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:53.981751 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e011fba2-1bb3-4268-b910-f218dd9dfef4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:53.982639 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e011fba2-1bb3-4268-b910-f218dd9dfef4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:54.000068 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e011fba2-1bb3-4268-b910-f218dd9dfef4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:54.001177 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e011fba2-1bb3-4268-b910-f218dd9dfef4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:54.003819 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e011fba2-1bb3-4268-b910-f218dd9dfef4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:54.004630 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e011fba2-1bb3-4268-b910-f218dd9dfef4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:54.005100 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e011fba2-1bb3-4268-b910-f218dd9dfef4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:54.005533 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e011fba2-1bb3-4268-b910-f218dd9dfef4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:54.246288 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e011fba2-1bb3-4268-b910-f218dd9dfef4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:54.262315 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e011fba2-1bb3-4268-b910-f218dd9dfef4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:54.263833 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e011fba2-1bb3-4268-b910-f218dd9dfef4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:54.265240 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e011fba2-1bb3-4268-b910-f218dd9dfef4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1407 microversion: 2.20 time: 0.301335 Sep 01 16:36:54.266062 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 49/106] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:53 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1407 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:36:54.274716 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-03d3c88e-1c91-49c5-8b32-263b75c1d329 req-1459c9df-89e3-48f0-8f9c-96b8f339e8c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b16ceffd-c9b2-49e6-a44d-7353a17f230a", "tag": "b4253844-4c55-43ea-a36b-20d7a499e811"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:54.288437 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-03d3c88e-1c91-49c5-8b32-263b75c1d329 req-1459c9df-89e3-48f0-8f9c-96b8f339e8c6 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:54.289232 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-03d3c88e-1c91-49c5-8b32-263b75c1d329 req-1459c9df-89e3-48f0-8f9c-96b8f339e8c6 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:54.289892 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-03d3c88e-1c91-49c5-8b32-263b75c1d329 req-1459c9df-89e3-48f0-8f9c-96b8f339e8c6 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:54.320682 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-03d3c88e-1c91-49c5-8b32-263b75c1d329 req-1459c9df-89e3-48f0-8f9c-96b8f339e8c6 service nova] Creating event network-changed:b4253844-4c55-43ea-a36b-20d7a499e811 for instance b16ceffd-c9b2-49e6-a44d-7353a17f230a on hv-cinder-85221 Sep 01 16:36:54.323624 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-03d3c88e-1c91-49c5-8b32-263b75c1d329 req-1459c9df-89e3-48f0-8f9c-96b8f339e8c6 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127199) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 16:36:54.324646 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-03d3c88e-1c91-49c5-8b32-263b75c1d329 req-1459c9df-89e3-48f0-8f9c-96b8f339e8c6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127199) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 16:36:54.327837 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d6470b40-705a-4033-a723-8c063b3587fb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:54.333003 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d6470b40-705a-4033-a723-8c063b3587fb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:54.333737 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d6470b40-705a-4033-a723-8c063b3587fb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:54.350086 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d6470b40-705a-4033-a723-8c063b3587fb None None] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:54.350086 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d6470b40-705a-4033-a723-8c063b3587fb None None] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:54.350086 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d6470b40-705a-4033-a723-8c063b3587fb None None] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:54.362569 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.compute.rpcapi [None req-d6470b40-705a-4033-a723-8c063b3587fb None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 01 16:36:54.364034 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d6470b40-705a-4033-a723-8c063b3587fb None None] Releasing lock "compute-rpcapi-router" {{(pid=127199) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 16:36:54.385150 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d6470b40-705a-4033-a723-8c063b3587fb None None] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.511764 Sep 01 16:36:54.390320 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 58/107] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:36:54.395541 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-5492d278-611e-4535-b185-1c5c7d10255d req-2333da6f-360f-46c3-bcad-85e83c05bce8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bd544a7-a62e-434f-a842-e6231482d926", "tag": "2b8edb3c-5370-457e-be23-aab3a6c7d12d"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:54.414288 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-5492d278-611e-4535-b185-1c5c7d10255d req-2333da6f-360f-46c3-bcad-85e83c05bce8 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:54.416747 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-5492d278-611e-4535-b185-1c5c7d10255d req-2333da6f-360f-46c3-bcad-85e83c05bce8 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:54.418147 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-5492d278-611e-4535-b185-1c5c7d10255d req-2333da6f-360f-46c3-bcad-85e83c05bce8 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:54.445572 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-5492d278-611e-4535-b185-1c5c7d10255d req-2333da6f-360f-46c3-bcad-85e83c05bce8 service nova] Creating event network-changed:2b8edb3c-5370-457e-be23-aab3a6c7d12d for instance 5bd544a7-a62e-434f-a842-e6231482d926 on hv-cinder-85221 Sep 01 16:36:54.452840 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-5492d278-611e-4535-b185-1c5c7d10255d req-2333da6f-360f-46c3-bcad-85e83c05bce8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068926 Sep 01 16:36:54.454219 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 50/108] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:36:54.462161 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d1c967a6-3a42-4b14-adca-409e09142282 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:54.463271 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d1c967a6-3a42-4b14-adca-409e09142282 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:54.471172 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d1c967a6-3a42-4b14-adca-409e09142282 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:54.471854 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d1c967a6-3a42-4b14-adca-409e09142282 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:54.472502 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d1c967a6-3a42-4b14-adca-409e09142282 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:54.473689 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d1c967a6-3a42-4b14-adca-409e09142282 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:54.474426 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d1c967a6-3a42-4b14-adca-409e09142282 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:54.475016 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d1c967a6-3a42-4b14-adca-409e09142282 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:54.508258 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9c4d3efd-82e0-467f-9dd9-984c1e8b1c01 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:54.508890 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9c4d3efd-82e0-467f-9dd9-984c1e8b1c01 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: b16ceffd-c9b2-49e6-a44d-7353a17f230a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:54.525419 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9c4d3efd-82e0-467f-9dd9-984c1e8b1c01 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:54.525909 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9c4d3efd-82e0-467f-9dd9-984c1e8b1c01 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:54.526345 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9c4d3efd-82e0-467f-9dd9-984c1e8b1c01 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:54.528612 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9c4d3efd-82e0-467f-9dd9-984c1e8b1c01 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:54.529088 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9c4d3efd-82e0-467f-9dd9-984c1e8b1c01 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:54.529523 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9c4d3efd-82e0-467f-9dd9-984c1e8b1c01 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:54.723752 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d1c967a6-3a42-4b14-adca-409e09142282 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:54.749310 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d1c967a6-3a42-4b14-adca-409e09142282 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1360 microversion: 2.1 time: 0.297765 Sep 01 16:36:54.751041 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 59/109] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:54 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1360 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:54.775794 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9c4d3efd-82e0-467f-9dd9-984c1e8b1c01 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:54.788406 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9c4d3efd-82e0-467f-9dd9-984c1e8b1c01 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a" status: 200 len: 1366 microversion: 2.1 time: 0.285097 Sep 01 16:36:54.789582 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 51/110] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:54 2022] GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a => generated 1366 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:54.884149 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-2f031479-3d2e-43b0-80cb-0e8d15cf112f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:54.885821 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-2f031479-3d2e-43b0-80cb-0e8d15cf112f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:54.896586 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2f031479-3d2e-43b0-80cb-0e8d15cf112f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:54.897472 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2f031479-3d2e-43b0-80cb-0e8d15cf112f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:54.898151 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2f031479-3d2e-43b0-80cb-0e8d15cf112f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:54.899148 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2f031479-3d2e-43b0-80cb-0e8d15cf112f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:54.899878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2f031479-3d2e-43b0-80cb-0e8d15cf112f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:54.900732 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2f031479-3d2e-43b0-80cb-0e8d15cf112f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:54.984536 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d2645369-c715-426a-a933-82e3f8b33931 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:54.985239 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d2645369-c715-426a-a933-82e3f8b33931 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] [instance: 5bd544a7-a62e-434f-a842-e6231482d926] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:54.996924 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d2645369-c715-426a-a933-82e3f8b33931 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:55.000710 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d2645369-c715-426a-a933-82e3f8b33931 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:55.003342 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d2645369-c715-426a-a933-82e3f8b33931 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:55.006676 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d2645369-c715-426a-a933-82e3f8b33931 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:55.007387 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d2645369-c715-426a-a933-82e3f8b33931 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:55.008924 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d2645369-c715-426a-a933-82e3f8b33931 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:55.969165 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-2f031479-3d2e-43b0-80cb-0e8d15cf112f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:55.978002 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-2f031479-3d2e-43b0-80cb-0e8d15cf112f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1322 microversion: 2.1 time: 1.098756 Sep 01 16:36:55.985329 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 60/111] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:54 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1322 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:55.990340 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-09116662-d495-4fbe-bdd9-f2888e84d3cc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:55.996779 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-09116662-d495-4fbe-bdd9-f2888e84d3cc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:56.012801 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-09116662-d495-4fbe-bdd9-f2888e84d3cc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:56.013993 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-09116662-d495-4fbe-bdd9-f2888e84d3cc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:56.015082 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-09116662-d495-4fbe-bdd9-f2888e84d3cc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:56.016098 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-09116662-d495-4fbe-bdd9-f2888e84d3cc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:56.016988 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-09116662-d495-4fbe-bdd9-f2888e84d3cc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:56.017612 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-09116662-d495-4fbe-bdd9-f2888e84d3cc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:56.215941 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d2645369-c715-426a-a933-82e3f8b33931 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b1fea950d48ef9a55cded8ed172a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130966aabcc04fc98c9f5139f826e78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:56.227699 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d2645369-c715-426a-a933-82e3f8b33931 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] 10.222.0.62 "GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926" status: 200 len: 1314 microversion: 2.1 time: 1.248925 Sep 01 16:36:56.229694 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 52/112] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:54 2022] GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926 => generated 1314 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:56.242597 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-69616d69-1f72-45f5-8c48-4f3e6449295d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:56.245856 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-69616d69-1f72-45f5-8c48-4f3e6449295d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:56.278007 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-69616d69-1f72-45f5-8c48-4f3e6449295d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:56.281033 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-69616d69-1f72-45f5-8c48-4f3e6449295d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:56.282291 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-69616d69-1f72-45f5-8c48-4f3e6449295d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:56.283305 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-69616d69-1f72-45f5-8c48-4f3e6449295d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:56.286238 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-69616d69-1f72-45f5-8c48-4f3e6449295d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:56.287102 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-69616d69-1f72-45f5-8c48-4f3e6449295d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:56.614675 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-09116662-d495-4fbe-bdd9-f2888e84d3cc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:56.623559 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-09116662-d495-4fbe-bdd9-f2888e84d3cc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:56.625032 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-09116662-d495-4fbe-bdd9-f2888e84d3cc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:56.626151 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-09116662-d495-4fbe-bdd9-f2888e84d3cc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1407 microversion: 2.20 time: 0.639507 Sep 01 16:36:56.626708 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 61/113] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:55 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1407 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:36:56.631042 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-58d10a8e-3140-46e9-bd8c-79fd8cb68e0d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:56.631870 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-58d10a8e-3140-46e9-bd8c-79fd8cb68e0d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: b16ceffd-c9b2-49e6-a44d-7353a17f230a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:56.638086 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-58d10a8e-3140-46e9-bd8c-79fd8cb68e0d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:56.638576 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-58d10a8e-3140-46e9-bd8c-79fd8cb68e0d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:56.638992 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-58d10a8e-3140-46e9-bd8c-79fd8cb68e0d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:56.639690 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-58d10a8e-3140-46e9-bd8c-79fd8cb68e0d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:56.640178 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-58d10a8e-3140-46e9-bd8c-79fd8cb68e0d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:56.640592 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-58d10a8e-3140-46e9-bd8c-79fd8cb68e0d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:56.643738 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-69616d69-1f72-45f5-8c48-4f3e6449295d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:56.651426 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-69616d69-1f72-45f5-8c48-4f3e6449295d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1360 microversion: 2.1 time: 0.420347 Sep 01 16:36:56.652051 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 53/114] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:56 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1360 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:56.656578 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-d6a43a1c-dd89-46a1-b6ec-2ddf66d92f1d req-200622c2-9676-4cc5-b0ae-d1eadc4ae90c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3be929ac-f249-4540-9ff2-3519a68231ff", "tag": "d904d72e-18b3-41a4-aba4-c49c839b8377"}, {"name": "network-changed", "server_uuid": "8ddc2614-8a62-4c61-a086-8dbab65e1f4a", "tag": "9d73b218-5a3f-4e30-9685-717b1fbfe797"}, {"name": "network-changed", "server_uuid": "a1bf96dd-b79a-403b-aa81-985c692df037", "tag": "89467631-d9b5-466b-89fd-219067a07f3e"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:56.667579 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-d6a43a1c-dd89-46a1-b6ec-2ddf66d92f1d req-200622c2-9676-4cc5-b0ae-d1eadc4ae90c service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:56.668087 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-d6a43a1c-dd89-46a1-b6ec-2ddf66d92f1d req-200622c2-9676-4cc5-b0ae-d1eadc4ae90c service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:56.668708 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-d6a43a1c-dd89-46a1-b6ec-2ddf66d92f1d req-200622c2-9676-4cc5-b0ae-d1eadc4ae90c service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:56.683659 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-d6a43a1c-dd89-46a1-b6ec-2ddf66d92f1d req-200622c2-9676-4cc5-b0ae-d1eadc4ae90c service nova] Creating event network-changed:d904d72e-18b3-41a4-aba4-c49c839b8377 for instance 3be929ac-f249-4540-9ff2-3519a68231ff on hv-cinder-85221 Sep 01 16:36:56.684174 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-d6a43a1c-dd89-46a1-b6ec-2ddf66d92f1d req-200622c2-9676-4cc5-b0ae-d1eadc4ae90c service nova] Creating event network-changed:9d73b218-5a3f-4e30-9685-717b1fbfe797 for instance 8ddc2614-8a62-4c61-a086-8dbab65e1f4a on hv-cinder-85221 Sep 01 16:36:56.684677 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-d6a43a1c-dd89-46a1-b6ec-2ddf66d92f1d req-200622c2-9676-4cc5-b0ae-d1eadc4ae90c service nova] Creating event network-changed:89467631-d9b5-466b-89fd-219067a07f3e for instance a1bf96dd-b79a-403b-aa81-985c692df037 on hv-cinder-85221 Sep 01 16:36:56.692589 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-d6a43a1c-dd89-46a1-b6ec-2ddf66d92f1d req-200622c2-9676-4cc5-b0ae-d1eadc4ae90c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.039388 Sep 01 16:36:56.693198 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 54/115] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:36:56.794469 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-58d10a8e-3140-46e9-bd8c-79fd8cb68e0d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:56.802988 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-58d10a8e-3140-46e9-bd8c-79fd8cb68e0d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a" status: 200 len: 1366 microversion: 2.1 time: 0.175272 Sep 01 16:36:56.803564 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 62/116] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:56 2022] GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:57.006435 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c98af60c-48f2-46f5-84f8-79ddf1096730 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:57.007148 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c98af60c-48f2-46f5-84f8-79ddf1096730 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:57.016976 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c98af60c-48f2-46f5-84f8-79ddf1096730 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:57.017762 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c98af60c-48f2-46f5-84f8-79ddf1096730 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:57.018208 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c98af60c-48f2-46f5-84f8-79ddf1096730 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:57.019802 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c98af60c-48f2-46f5-84f8-79ddf1096730 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:57.020508 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c98af60c-48f2-46f5-84f8-79ddf1096730 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:57.021044 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c98af60c-48f2-46f5-84f8-79ddf1096730 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:57.154547 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c98af60c-48f2-46f5-84f8-79ddf1096730 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:57.162256 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c98af60c-48f2-46f5-84f8-79ddf1096730 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1322 microversion: 2.1 time: 0.160291 Sep 01 16:36:57.162808 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 55/117] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:57 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:57.250460 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d798bb01-6304-4db1-9597-de99deab71a1 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:57.251076 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d798bb01-6304-4db1-9597-de99deab71a1 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] [instance: 5bd544a7-a62e-434f-a842-e6231482d926] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:57.257819 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d798bb01-6304-4db1-9597-de99deab71a1 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:57.258351 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d798bb01-6304-4db1-9597-de99deab71a1 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:57.258785 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d798bb01-6304-4db1-9597-de99deab71a1 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:57.259477 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d798bb01-6304-4db1-9597-de99deab71a1 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:57.260001 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d798bb01-6304-4db1-9597-de99deab71a1 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:57.260614 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d798bb01-6304-4db1-9597-de99deab71a1 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:57.400073 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d798bb01-6304-4db1-9597-de99deab71a1 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b1fea950d48ef9a55cded8ed172a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130966aabcc04fc98c9f5139f826e78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:57.405314 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=100 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:57.412709 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d798bb01-6304-4db1-9597-de99deab71a1 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] 10.222.0.62 "GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926" status: 200 len: 1314 microversion: 2.1 time: 0.166036 Sep 01 16:36:57.413453 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 63/118] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:57 2022] GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:57.651700 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2b521d73-637b-4155-baf5-7c44460c75fb tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:57.653526 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-2b521d73-637b-4155-baf5-7c44460c75fb tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:57.676381 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-82febbcb-6339-46c2-8420-53fbe29782cf tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:57.677210 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-82febbcb-6339-46c2-8420-53fbe29782cf tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:57.683982 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2b521d73-637b-4155-baf5-7c44460c75fb tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:57.686951 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2b521d73-637b-4155-baf5-7c44460c75fb tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:57.687432 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2b521d73-637b-4155-baf5-7c44460c75fb tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:57.689642 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-82febbcb-6339-46c2-8420-53fbe29782cf tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:57.690628 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2b521d73-637b-4155-baf5-7c44460c75fb tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:57.691311 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2b521d73-637b-4155-baf5-7c44460c75fb tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:57.692387 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2b521d73-637b-4155-baf5-7c44460c75fb tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:57.692828 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-82febbcb-6339-46c2-8420-53fbe29782cf tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:57.700577 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-82febbcb-6339-46c2-8420-53fbe29782cf tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:57.706975 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-82febbcb-6339-46c2-8420-53fbe29782cf tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:57.707645 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-82febbcb-6339-46c2-8420-53fbe29782cf tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:57.708747 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-82febbcb-6339-46c2-8420-53fbe29782cf tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:57.769094 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=100 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:58.498480 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-82febbcb-6339-46c2-8420-53fbe29782cf tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:58.509355 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-82febbcb-6339-46c2-8420-53fbe29782cf tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1360 microversion: 2.1 time: 0.840251 Sep 01 16:36:58.509971 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 64/119] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:57 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1360 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:58.516228 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-67d23fac-eeca-49b6-8f3a-21fdc99bfd3a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:58.517164 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-67d23fac-eeca-49b6-8f3a-21fdc99bfd3a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: b16ceffd-c9b2-49e6-a44d-7353a17f230a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:58.518874 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2b521d73-637b-4155-baf5-7c44460c75fb tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:58.530272 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-67d23fac-eeca-49b6-8f3a-21fdc99bfd3a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:58.531130 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-67d23fac-eeca-49b6-8f3a-21fdc99bfd3a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:58.531859 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-67d23fac-eeca-49b6-8f3a-21fdc99bfd3a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:58.533041 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-67d23fac-eeca-49b6-8f3a-21fdc99bfd3a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:58.533802 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2b521d73-637b-4155-baf5-7c44460c75fb tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:58.534075 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-67d23fac-eeca-49b6-8f3a-21fdc99bfd3a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:58.534565 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-67d23fac-eeca-49b6-8f3a-21fdc99bfd3a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:58.535822 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2b521d73-637b-4155-baf5-7c44460c75fb tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:58.537211 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2b521d73-637b-4155-baf5-7c44460c75fb tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1407 microversion: 2.20 time: 0.892067 Sep 01 16:36:58.538433 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 56/120] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:57 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1407 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:36:58.543946 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-81647213-4981-497a-b140-5189bd1b546e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:58.544935 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-81647213-4981-497a-b140-5189bd1b546e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:58.552401 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-81647213-4981-497a-b140-5189bd1b546e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:58.553396 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-81647213-4981-497a-b140-5189bd1b546e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:58.553958 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-81647213-4981-497a-b140-5189bd1b546e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:58.554970 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-81647213-4981-497a-b140-5189bd1b546e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:58.556213 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-81647213-4981-497a-b140-5189bd1b546e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:58.556718 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-81647213-4981-497a-b140-5189bd1b546e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:58.915102 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-67d23fac-eeca-49b6-8f3a-21fdc99bfd3a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:58.923790 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-67d23fac-eeca-49b6-8f3a-21fdc99bfd3a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a" status: 200 len: 1366 microversion: 2.1 time: 0.412744 Sep 01 16:36:58.924416 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 65/121] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:58 2022] GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a => generated 1366 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:58.929041 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-416d0c8c-fc95-4b7c-8803-92a0188a8351 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:58.940139 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-416d0c8c-fc95-4b7c-8803-92a0188a8351 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] [instance: 5bd544a7-a62e-434f-a842-e6231482d926] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:58.951857 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-416d0c8c-fc95-4b7c-8803-92a0188a8351 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:58.952374 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-416d0c8c-fc95-4b7c-8803-92a0188a8351 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:58.952801 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-416d0c8c-fc95-4b7c-8803-92a0188a8351 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:58.953502 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-416d0c8c-fc95-4b7c-8803-92a0188a8351 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:58.954305 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-416d0c8c-fc95-4b7c-8803-92a0188a8351 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:58.954695 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-416d0c8c-fc95-4b7c-8803-92a0188a8351 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:58.972235 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-81647213-4981-497a-b140-5189bd1b546e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:58.985560 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-81647213-4981-497a-b140-5189bd1b546e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1322 microversion: 2.1 time: 0.445568 Sep 01 16:36:58.987207 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 57/122] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:58 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1322 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:59.200992 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-416d0c8c-fc95-4b7c-8803-92a0188a8351 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b1fea950d48ef9a55cded8ed172a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130966aabcc04fc98c9f5139f826e78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:59.215024 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-416d0c8c-fc95-4b7c-8803-92a0188a8351 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] 10.222.0.62 "GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926" status: 200 len: 1314 microversion: 2.1 time: 0.289231 Sep 01 16:36:59.215925 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 66/123] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:58 2022] GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:59.533961 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-bc750e08-ea35-4ba0-a453-ffec4e13323d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:59.535266 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-bc750e08-ea35-4ba0-a453-ffec4e13323d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:59.543418 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bc750e08-ea35-4ba0-a453-ffec4e13323d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:59.544256 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bc750e08-ea35-4ba0-a453-ffec4e13323d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:59.545086 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bc750e08-ea35-4ba0-a453-ffec4e13323d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:59.546005 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bc750e08-ea35-4ba0-a453-ffec4e13323d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:59.546582 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bc750e08-ea35-4ba0-a453-ffec4e13323d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:59.547307 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bc750e08-ea35-4ba0-a453-ffec4e13323d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:59.561274 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-46fb3d7d-c601-4149-89de-39e5fdc5d686 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:59.561870 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-46fb3d7d-c601-4149-89de-39e5fdc5d686 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:59.570936 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-46fb3d7d-c601-4149-89de-39e5fdc5d686 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:59.571858 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-46fb3d7d-c601-4149-89de-39e5fdc5d686 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:59.572615 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-46fb3d7d-c601-4149-89de-39e5fdc5d686 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:59.573461 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-46fb3d7d-c601-4149-89de-39e5fdc5d686 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:59.574260 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-46fb3d7d-c601-4149-89de-39e5fdc5d686 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:59.574954 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-46fb3d7d-c601-4149-89de-39e5fdc5d686 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:59.833180 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-bc750e08-ea35-4ba0-a453-ffec4e13323d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:59.842859 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-bc750e08-ea35-4ba0-a453-ffec4e13323d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1360 microversion: 2.1 time: 0.313609 Sep 01 16:36:59.844051 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 58/124] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:59 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1360 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:59.948090 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-46fb3d7d-c601-4149-89de-39e5fdc5d686 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:59.951108 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-874aa2de-fc94-48a5-a15a-6801c58cb313 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:59.952074 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-874aa2de-fc94-48a5-a15a-6801c58cb313 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: b16ceffd-c9b2-49e6-a44d-7353a17f230a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:59.959405 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-874aa2de-fc94-48a5-a15a-6801c58cb313 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:59.960194 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-874aa2de-fc94-48a5-a15a-6801c58cb313 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:59.960807 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-874aa2de-fc94-48a5-a15a-6801c58cb313 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:59.961769 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-874aa2de-fc94-48a5-a15a-6801c58cb313 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:59.962528 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-874aa2de-fc94-48a5-a15a-6801c58cb313 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:59.963310 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-874aa2de-fc94-48a5-a15a-6801c58cb313 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:59.964559 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-46fb3d7d-c601-4149-89de-39e5fdc5d686 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:59.969910 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-46fb3d7d-c601-4149-89de-39e5fdc5d686 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:59.973103 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-46fb3d7d-c601-4149-89de-39e5fdc5d686 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1407 microversion: 2.20 time: 0.414342 Sep 01 16:36:59.985903 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 67/125] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:59 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1407 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:37:00.014489 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-79150042-2d47-4572-acc8-b2efc708d5c9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:00.015705 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-79150042-2d47-4572-acc8-b2efc708d5c9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:00.024092 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-79150042-2d47-4572-acc8-b2efc708d5c9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:00.024978 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-79150042-2d47-4572-acc8-b2efc708d5c9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:00.025622 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-79150042-2d47-4572-acc8-b2efc708d5c9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:00.026539 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-79150042-2d47-4572-acc8-b2efc708d5c9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:00.027549 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-79150042-2d47-4572-acc8-b2efc708d5c9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:00.028359 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-79150042-2d47-4572-acc8-b2efc708d5c9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:00.227690 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-874aa2de-fc94-48a5-a15a-6801c58cb313 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:00.237032 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-874aa2de-fc94-48a5-a15a-6801c58cb313 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a" status: 200 len: 1366 microversion: 2.1 time: 0.290711 Sep 01 16:37:00.238134 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 59/126] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:59 2022] GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a => generated 1366 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:00.251865 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1d15654e-2258-4a00-9049-18e2be7800b8 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:00.253055 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1d15654e-2258-4a00-9049-18e2be7800b8 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] [instance: 5bd544a7-a62e-434f-a842-e6231482d926] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:00.266099 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1d15654e-2258-4a00-9049-18e2be7800b8 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:00.276789 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1d15654e-2258-4a00-9049-18e2be7800b8 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:00.277483 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1d15654e-2258-4a00-9049-18e2be7800b8 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:00.278393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1d15654e-2258-4a00-9049-18e2be7800b8 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:00.278872 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1d15654e-2258-4a00-9049-18e2be7800b8 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:00.279293 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1d15654e-2258-4a00-9049-18e2be7800b8 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:00.568282 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-79150042-2d47-4572-acc8-b2efc708d5c9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:00.584375 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-79150042-2d47-4572-acc8-b2efc708d5c9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1322 microversion: 2.1 time: 0.574956 Sep 01 16:37:00.598753 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 68/127] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:00 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1322 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:37:00.729031 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1d15654e-2258-4a00-9049-18e2be7800b8 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b1fea950d48ef9a55cded8ed172a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130966aabcc04fc98c9f5139f826e78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:00.744183 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1d15654e-2258-4a00-9049-18e2be7800b8 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] 10.222.0.62 "GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926" status: 200 len: 1314 microversion: 2.1 time: 0.504524 Sep 01 16:37:00.748242 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 60/128] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:00 2022] GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926 => generated 1314 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:00.868439 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-4bdacb00-fda4-4abc-abe0-e47be76876f9 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:00.869103 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-4bdacb00-fda4-4abc-abe0-e47be76876f9 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:00.880434 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4bdacb00-fda4-4abc-abe0-e47be76876f9 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:00.881028 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4bdacb00-fda4-4abc-abe0-e47be76876f9 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:00.881516 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4bdacb00-fda4-4abc-abe0-e47be76876f9 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:00.882558 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4bdacb00-fda4-4abc-abe0-e47be76876f9 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:00.883785 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4bdacb00-fda4-4abc-abe0-e47be76876f9 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:00.884440 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4bdacb00-fda4-4abc-abe0-e47be76876f9 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:00.998848 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e6350dd1-3a88-4112-958a-463c2ea7bc90 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:00.999459 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e6350dd1-3a88-4112-958a-463c2ea7bc90 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:01.016598 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e6350dd1-3a88-4112-958a-463c2ea7bc90 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:01.018389 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e6350dd1-3a88-4112-958a-463c2ea7bc90 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:01.018855 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e6350dd1-3a88-4112-958a-463c2ea7bc90 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:01.019573 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e6350dd1-3a88-4112-958a-463c2ea7bc90 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:01.024665 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e6350dd1-3a88-4112-958a-463c2ea7bc90 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:01.025122 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e6350dd1-3a88-4112-958a-463c2ea7bc90 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:01.200891 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-4bdacb00-fda4-4abc-abe0-e47be76876f9 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:01.214466 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-4bdacb00-fda4-4abc-abe0-e47be76876f9 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1360 microversion: 2.1 time: 0.352619 Sep 01 16:37:01.216927 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 69/129] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:00 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1360 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:01.510757 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-a0b2c1fc-ebc0-4c2a-9900-825d34934f03 req-6f42f9ea-db5f-4f0b-acd1-78f383db70fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3be929ac-f249-4540-9ff2-3519a68231ff", "name": "network-vif-plugged", "status": "completed", "tag": "d904d72e-18b3-41a4-aba4-c49c839b8377"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:01.512676 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e6350dd1-3a88-4112-958a-463c2ea7bc90 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:01.524957 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e6350dd1-3a88-4112-958a-463c2ea7bc90 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:01.527703 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e6350dd1-3a88-4112-958a-463c2ea7bc90 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:01.533245 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e6350dd1-3a88-4112-958a-463c2ea7bc90 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1407 microversion: 2.20 time: 0.539038 Sep 01 16:37:01.545954 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-a0b2c1fc-ebc0-4c2a-9900-825d34934f03 req-6f42f9ea-db5f-4f0b-acd1-78f383db70fa service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:01.547570 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 61/130] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:00 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1407 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:37:01.547942 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-a0b2c1fc-ebc0-4c2a-9900-825d34934f03 req-6f42f9ea-db5f-4f0b-acd1-78f383db70fa service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:01.550275 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-a0b2c1fc-ebc0-4c2a-9900-825d34934f03 req-6f42f9ea-db5f-4f0b-acd1-78f383db70fa service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:01.561008 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-30243ad6-040f-4055-918c-d4c2b08b6307 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:01.561609 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-30243ad6-040f-4055-918c-d4c2b08b6307 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: b16ceffd-c9b2-49e6-a44d-7353a17f230a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:01.581445 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-30243ad6-040f-4055-918c-d4c2b08b6307 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:01.582221 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-30243ad6-040f-4055-918c-d4c2b08b6307 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:01.583083 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-30243ad6-040f-4055-918c-d4c2b08b6307 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:01.583976 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-30243ad6-040f-4055-918c-d4c2b08b6307 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:01.584569 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-30243ad6-040f-4055-918c-d4c2b08b6307 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:01.585124 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-30243ad6-040f-4055-918c-d4c2b08b6307 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:01.593848 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-a0b2c1fc-ebc0-4c2a-9900-825d34934f03 req-6f42f9ea-db5f-4f0b-acd1-78f383db70fa service nova] Creating event network-vif-plugged:d904d72e-18b3-41a4-aba4-c49c839b8377 for instance 3be929ac-f249-4540-9ff2-3519a68231ff on hv-cinder-85221 Sep 01 16:37:01.610827 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-a0b2c1fc-ebc0-4c2a-9900-825d34934f03 req-6f42f9ea-db5f-4f0b-acd1-78f383db70fa service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.360692 Sep 01 16:37:01.612160 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 70/131] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:37:01.638032 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-9f656727-688b-4e55-a718-5af182bd84c1 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:01.639919 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-9f656727-688b-4e55-a718-5af182bd84c1 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:01.661394 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9f656727-688b-4e55-a718-5af182bd84c1 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:01.665677 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9f656727-688b-4e55-a718-5af182bd84c1 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:01.666555 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9f656727-688b-4e55-a718-5af182bd84c1 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:01.667723 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9f656727-688b-4e55-a718-5af182bd84c1 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:01.669041 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9f656727-688b-4e55-a718-5af182bd84c1 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:01.671390 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9f656727-688b-4e55-a718-5af182bd84c1 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:01.877736 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-30243ad6-040f-4055-918c-d4c2b08b6307 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:01.888224 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-30243ad6-040f-4055-918c-d4c2b08b6307 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a" status: 200 len: 1366 microversion: 2.1 time: 0.339407 Sep 01 16:37:01.889883 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 62/132] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:01 2022] GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a => generated 1366 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:01.898250 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0e6ca9f7-47ed-4322-bfac-949817b4b49c tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:01.900652 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0e6ca9f7-47ed-4322-bfac-949817b4b49c tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] [instance: 5bd544a7-a62e-434f-a842-e6231482d926] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:01.918496 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0e6ca9f7-47ed-4322-bfac-949817b4b49c tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:01.921323 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0e6ca9f7-47ed-4322-bfac-949817b4b49c tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:01.921779 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0e6ca9f7-47ed-4322-bfac-949817b4b49c tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:01.922505 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0e6ca9f7-47ed-4322-bfac-949817b4b49c tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:01.922968 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0e6ca9f7-47ed-4322-bfac-949817b4b49c tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:01.923399 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0e6ca9f7-47ed-4322-bfac-949817b4b49c tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:01.937662 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-9f656727-688b-4e55-a718-5af182bd84c1 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:01.947120 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-9f656727-688b-4e55-a718-5af182bd84c1 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1322 microversion: 2.1 time: 0.326309 Sep 01 16:37:01.947745 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 71/133] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:01 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1322 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:02.120874 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0e6ca9f7-47ed-4322-bfac-949817b4b49c tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b1fea950d48ef9a55cded8ed172a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130966aabcc04fc98c9f5139f826e78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:02.131071 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0e6ca9f7-47ed-4322-bfac-949817b4b49c tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] 10.222.0.62 "GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926" status: 200 len: 1314 microversion: 2.1 time: 0.239924 Sep 01 16:37:02.131690 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 63/134] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:01 2022] GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:02.243073 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-aceb43f3-b9d7-4652-8f3f-23cdec514f7b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:02.243675 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-aceb43f3-b9d7-4652-8f3f-23cdec514f7b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:02.252517 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aceb43f3-b9d7-4652-8f3f-23cdec514f7b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:02.254629 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aceb43f3-b9d7-4652-8f3f-23cdec514f7b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:02.256066 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aceb43f3-b9d7-4652-8f3f-23cdec514f7b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:02.257833 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aceb43f3-b9d7-4652-8f3f-23cdec514f7b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:02.259108 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aceb43f3-b9d7-4652-8f3f-23cdec514f7b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:02.259556 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aceb43f3-b9d7-4652-8f3f-23cdec514f7b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:02.567245 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9439bb44-f58a-4969-8a2c-24d06c851faf tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:02.568038 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9439bb44-f58a-4969-8a2c-24d06c851faf tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:02.570139 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:02.577875 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9439bb44-f58a-4969-8a2c-24d06c851faf tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:02.578360 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9439bb44-f58a-4969-8a2c-24d06c851faf tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:02.579197 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9439bb44-f58a-4969-8a2c-24d06c851faf tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:02.579875 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9439bb44-f58a-4969-8a2c-24d06c851faf tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:02.580267 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9439bb44-f58a-4969-8a2c-24d06c851faf tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:02.580680 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9439bb44-f58a-4969-8a2c-24d06c851faf tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:02.648217 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-aceb43f3-b9d7-4652-8f3f-23cdec514f7b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:02.659447 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-aceb43f3-b9d7-4652-8f3f-23cdec514f7b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1360 microversion: 2.1 time: 0.420092 Sep 01 16:37:02.662449 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 72/135] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:02 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1360 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:02.909286 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8db46222-6b21-4ed7-9061-b58d0571266c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:02.910159 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-8db46222-6b21-4ed7-9061-b58d0571266c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: b16ceffd-c9b2-49e6-a44d-7353a17f230a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:02.919706 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8db46222-6b21-4ed7-9061-b58d0571266c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:02.921150 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8db46222-6b21-4ed7-9061-b58d0571266c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:02.921877 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8db46222-6b21-4ed7-9061-b58d0571266c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:02.924041 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8db46222-6b21-4ed7-9061-b58d0571266c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:02.925370 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8db46222-6b21-4ed7-9061-b58d0571266c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:02.926065 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8db46222-6b21-4ed7-9061-b58d0571266c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:03.279632 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9439bb44-f58a-4969-8a2c-24d06c851faf tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:03.293428 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9439bb44-f58a-4969-8a2c-24d06c851faf tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:03.295603 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9439bb44-f58a-4969-8a2c-24d06c851faf tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:03.297250 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9439bb44-f58a-4969-8a2c-24d06c851faf tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1407 microversion: 2.20 time: 0.735848 Sep 01 16:37:03.298491 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 64/136] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:02 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1407 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:03.303201 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-411b07bd-1bf9-4f74-a596-9a40934eeabe tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:03.304003 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-411b07bd-1bf9-4f74-a596-9a40934eeabe tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:03.312709 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-411b07bd-1bf9-4f74-a596-9a40934eeabe tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:03.313343 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-411b07bd-1bf9-4f74-a596-9a40934eeabe tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:03.314080 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-411b07bd-1bf9-4f74-a596-9a40934eeabe tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:03.315067 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-411b07bd-1bf9-4f74-a596-9a40934eeabe tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:03.316322 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-411b07bd-1bf9-4f74-a596-9a40934eeabe tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:03.316898 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-411b07bd-1bf9-4f74-a596-9a40934eeabe tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:03.559343 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8db46222-6b21-4ed7-9061-b58d0571266c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:03.568147 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8db46222-6b21-4ed7-9061-b58d0571266c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a" status: 200 len: 1366 microversion: 2.1 time: 0.663172 Sep 01 16:37:03.569404 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 73/137] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:02 2022] GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a => generated 1366 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:37:03.574449 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-3ba817f4-328e-4ef2-bc72-fabb585fdd52 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:03.575333 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-3ba817f4-328e-4ef2-bc72-fabb585fdd52 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] [instance: 5bd544a7-a62e-434f-a842-e6231482d926] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:03.582475 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3ba817f4-328e-4ef2-bc72-fabb585fdd52 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:03.583291 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3ba817f4-328e-4ef2-bc72-fabb585fdd52 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:03.584155 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3ba817f4-328e-4ef2-bc72-fabb585fdd52 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:03.585097 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3ba817f4-328e-4ef2-bc72-fabb585fdd52 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:03.585983 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3ba817f4-328e-4ef2-bc72-fabb585fdd52 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:03.586609 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3ba817f4-328e-4ef2-bc72-fabb585fdd52 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:03.646611 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-411b07bd-1bf9-4f74-a596-9a40934eeabe tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:03.656084 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-411b07bd-1bf9-4f74-a596-9a40934eeabe tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1322 microversion: 2.1 time: 0.356331 Sep 01 16:37:03.660982 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 65/138] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:03 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1322 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:03.682917 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-56dfd642-2fea-4c68-b41b-4e93910bd65b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:03.683857 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-56dfd642-2fea-4c68-b41b-4e93910bd65b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:03.691279 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-56dfd642-2fea-4c68-b41b-4e93910bd65b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:03.692378 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-56dfd642-2fea-4c68-b41b-4e93910bd65b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:03.693270 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-56dfd642-2fea-4c68-b41b-4e93910bd65b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:03.694386 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-56dfd642-2fea-4c68-b41b-4e93910bd65b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:03.695058 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-56dfd642-2fea-4c68-b41b-4e93910bd65b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:03.696048 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-56dfd642-2fea-4c68-b41b-4e93910bd65b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:03.824210 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-3ba817f4-328e-4ef2-bc72-fabb585fdd52 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b1fea950d48ef9a55cded8ed172a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130966aabcc04fc98c9f5139f826e78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:03.837416 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-3ba817f4-328e-4ef2-bc72-fabb585fdd52 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] 10.222.0.62 "GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926" status: 200 len: 1314 microversion: 2.1 time: 0.266526 Sep 01 16:37:03.843560 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 74/139] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:03 2022] GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:03.983776 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-56dfd642-2fea-4c68-b41b-4e93910bd65b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:03.998774 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-56dfd642-2fea-4c68-b41b-4e93910bd65b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1360 microversion: 2.1 time: 0.320069 Sep 01 16:37:04.000916 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 66/140] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:03 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1360 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:37:04.326316 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-32cf99dd-9eab-4777-9be0-04053ff77aa4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:04.327760 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-32cf99dd-9eab-4777-9be0-04053ff77aa4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:04.338354 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-32cf99dd-9eab-4777-9be0-04053ff77aa4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:04.339212 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-32cf99dd-9eab-4777-9be0-04053ff77aa4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:04.340237 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-32cf99dd-9eab-4777-9be0-04053ff77aa4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:04.342655 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-32cf99dd-9eab-4777-9be0-04053ff77aa4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:04.343841 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-32cf99dd-9eab-4777-9be0-04053ff77aa4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:04.345014 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-32cf99dd-9eab-4777-9be0-04053ff77aa4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:04.380230 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=2 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:04.591330 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ab0315ea-17f9-4e44-a606-2e87e2614b87 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:04.592207 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ab0315ea-17f9-4e44-a606-2e87e2614b87 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: b16ceffd-c9b2-49e6-a44d-7353a17f230a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:04.604189 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-32cf99dd-9eab-4777-9be0-04053ff77aa4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:04.608731 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ab0315ea-17f9-4e44-a606-2e87e2614b87 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:04.615949 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ab0315ea-17f9-4e44-a606-2e87e2614b87 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:04.616952 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ab0315ea-17f9-4e44-a606-2e87e2614b87 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:04.618462 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-32cf99dd-9eab-4777-9be0-04053ff77aa4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:04.619488 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ab0315ea-17f9-4e44-a606-2e87e2614b87 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:04.622273 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ab0315ea-17f9-4e44-a606-2e87e2614b87 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:04.623935 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-32cf99dd-9eab-4777-9be0-04053ff77aa4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:04.624790 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ab0315ea-17f9-4e44-a606-2e87e2614b87 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:04.629151 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-32cf99dd-9eab-4777-9be0-04053ff77aa4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1407 microversion: 2.20 time: 0.308453 Sep 01 16:37:04.632347 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 75/141] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:04 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1407 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:04.678496 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0d041d77-243e-455b-9dfc-98e7c6598eb9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:04.679098 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-0d041d77-243e-455b-9dfc-98e7c6598eb9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:04.688403 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0d041d77-243e-455b-9dfc-98e7c6598eb9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:04.693226 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0d041d77-243e-455b-9dfc-98e7c6598eb9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:04.693984 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0d041d77-243e-455b-9dfc-98e7c6598eb9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:04.695052 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0d041d77-243e-455b-9dfc-98e7c6598eb9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:04.695438 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0d041d77-243e-455b-9dfc-98e7c6598eb9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:04.695852 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0d041d77-243e-455b-9dfc-98e7c6598eb9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:04.948285 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ab0315ea-17f9-4e44-a606-2e87e2614b87 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:04.964040 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ab0315ea-17f9-4e44-a606-2e87e2614b87 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a" status: 200 len: 1366 microversion: 2.1 time: 0.378275 Sep 01 16:37:04.966210 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 67/142] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:04 2022] GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a => generated 1366 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:04.973219 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-9aee40d0-fbcd-4e7d-918f-969d07ffef1e req-ca558e88-243d-4dca-87b1-f7a5d65beeac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1bf96dd-b79a-403b-aa81-985c692df037", "name": "network-vif-plugged", "status": "completed", "tag": "89467631-d9b5-466b-89fd-219067a07f3e"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:05.005271 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-9aee40d0-fbcd-4e7d-918f-969d07ffef1e req-ca558e88-243d-4dca-87b1-f7a5d65beeac service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:05.006133 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-9aee40d0-fbcd-4e7d-918f-969d07ffef1e req-ca558e88-243d-4dca-87b1-f7a5d65beeac service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:05.006772 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-9aee40d0-fbcd-4e7d-918f-969d07ffef1e req-ca558e88-243d-4dca-87b1-f7a5d65beeac service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:05.031343 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-9aee40d0-fbcd-4e7d-918f-969d07ffef1e req-ca558e88-243d-4dca-87b1-f7a5d65beeac service nova] Creating event network-vif-plugged:89467631-d9b5-466b-89fd-219067a07f3e for instance a1bf96dd-b79a-403b-aa81-985c692df037 on hv-cinder-85221 Sep 01 16:37:05.037886 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-9aee40d0-fbcd-4e7d-918f-969d07ffef1e req-ca558e88-243d-4dca-87b1-f7a5d65beeac service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068771 Sep 01 16:37:05.045132 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 68/143] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:37:05.060223 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-aa7af006-1020-415a-b595-530378b4ba4c tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:05.063243 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-aa7af006-1020-415a-b595-530378b4ba4c tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] [instance: 5bd544a7-a62e-434f-a842-e6231482d926] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:05.065669 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-0d041d77-243e-455b-9dfc-98e7c6598eb9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:05.075325 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-aa7af006-1020-415a-b595-530378b4ba4c tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:05.075815 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-aa7af006-1020-415a-b595-530378b4ba4c tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:05.076279 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-aa7af006-1020-415a-b595-530378b4ba4c tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:05.076985 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-aa7af006-1020-415a-b595-530378b4ba4c tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:05.077438 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-aa7af006-1020-415a-b595-530378b4ba4c tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:05.078072 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-aa7af006-1020-415a-b595-530378b4ba4c tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:05.080392 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-0d041d77-243e-455b-9dfc-98e7c6598eb9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1322 microversion: 2.1 time: 0.406417 Sep 01 16:37:05.091062 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 76/144] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:04 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1322 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:05.110395 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-80230ed0-b459-4a9c-9b86-4a54102f6aca tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:05.111136 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-80230ed0-b459-4a9c-9b86-4a54102f6aca tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:05.125758 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-80230ed0-b459-4a9c-9b86-4a54102f6aca tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:05.128861 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-80230ed0-b459-4a9c-9b86-4a54102f6aca tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:05.129618 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-80230ed0-b459-4a9c-9b86-4a54102f6aca tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:05.130529 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-80230ed0-b459-4a9c-9b86-4a54102f6aca tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:05.132221 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-80230ed0-b459-4a9c-9b86-4a54102f6aca tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:05.132905 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-80230ed0-b459-4a9c-9b86-4a54102f6aca tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:05.356953 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-aa7af006-1020-415a-b595-530378b4ba4c tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b1fea950d48ef9a55cded8ed172a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130966aabcc04fc98c9f5139f826e78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:05.376791 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-aa7af006-1020-415a-b595-530378b4ba4c tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] 10.222.0.62 "GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926" status: 200 len: 1314 microversion: 2.1 time: 0.328729 Sep 01 16:37:05.379209 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 69/145] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:05 2022] GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926 => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:05.382525 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-80230ed0-b459-4a9c-9b86-4a54102f6aca tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:05.391699 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-80230ed0-b459-4a9c-9b86-4a54102f6aca tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1360 microversion: 2.1 time: 0.297259 Sep 01 16:37:05.395104 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 77/146] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:05 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1360 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:05.655353 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-dbbc15d4-10c4-40cc-a731-0def9632d7a3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:05.656442 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-dbbc15d4-10c4-40cc-a731-0def9632d7a3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:05.666695 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dbbc15d4-10c4-40cc-a731-0def9632d7a3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:05.668212 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dbbc15d4-10c4-40cc-a731-0def9632d7a3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:05.668988 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dbbc15d4-10c4-40cc-a731-0def9632d7a3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:05.669995 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dbbc15d4-10c4-40cc-a731-0def9632d7a3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:05.670714 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dbbc15d4-10c4-40cc-a731-0def9632d7a3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:05.671464 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dbbc15d4-10c4-40cc-a731-0def9632d7a3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:05.987649 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-bef74500-370f-498d-adc9-9c242449721a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:05.988316 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-bef74500-370f-498d-adc9-9c242449721a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: b16ceffd-c9b2-49e6-a44d-7353a17f230a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:06.000557 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bef74500-370f-498d-adc9-9c242449721a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:06.001368 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bef74500-370f-498d-adc9-9c242449721a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:06.001854 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bef74500-370f-498d-adc9-9c242449721a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:06.002666 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bef74500-370f-498d-adc9-9c242449721a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:06.003229 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bef74500-370f-498d-adc9-9c242449721a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:06.007331 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bef74500-370f-498d-adc9-9c242449721a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:06.161575 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-dbbc15d4-10c4-40cc-a731-0def9632d7a3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:06.174691 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-dbbc15d4-10c4-40cc-a731-0def9632d7a3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:06.176873 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-dbbc15d4-10c4-40cc-a731-0def9632d7a3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:06.178179 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-dbbc15d4-10c4-40cc-a731-0def9632d7a3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1407 microversion: 2.20 time: 0.527328 Sep 01 16:37:06.178772 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 70/147] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:05 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1407 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:06.185625 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a00135de-8347-498a-b80a-22962eafdb8f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:06.186920 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a00135de-8347-498a-b80a-22962eafdb8f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:06.199951 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a00135de-8347-498a-b80a-22962eafdb8f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:06.200808 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a00135de-8347-498a-b80a-22962eafdb8f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:06.201233 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a00135de-8347-498a-b80a-22962eafdb8f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:06.203935 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a00135de-8347-498a-b80a-22962eafdb8f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:06.205507 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a00135de-8347-498a-b80a-22962eafdb8f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:06.206198 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a00135de-8347-498a-b80a-22962eafdb8f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:06.410827 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-bef74500-370f-498d-adc9-9c242449721a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:06.422571 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-bef74500-370f-498d-adc9-9c242449721a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a" status: 200 len: 1366 microversion: 2.1 time: 0.436370 Sep 01 16:37:06.422571 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 78/148] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:05 2022] GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a => generated 1366 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:37:06.426325 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-fe65b326-91ea-4522-a011-acdc7a34cd9a tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:06.427020 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-fe65b326-91ea-4522-a011-acdc7a34cd9a tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] [instance: 5bd544a7-a62e-434f-a842-e6231482d926] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:06.433215 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fe65b326-91ea-4522-a011-acdc7a34cd9a tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:06.434012 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fe65b326-91ea-4522-a011-acdc7a34cd9a tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:06.434671 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fe65b326-91ea-4522-a011-acdc7a34cd9a tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:06.435572 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fe65b326-91ea-4522-a011-acdc7a34cd9a tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:06.436276 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fe65b326-91ea-4522-a011-acdc7a34cd9a tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:06.436901 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fe65b326-91ea-4522-a011-acdc7a34cd9a tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:06.516788 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a00135de-8347-498a-b80a-22962eafdb8f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:06.526907 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a00135de-8347-498a-b80a-22962eafdb8f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1516 microversion: 2.1 time: 0.345710 Sep 01 16:37:06.540407 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 71/149] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:06 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1516 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:06.548671 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c9700a77-c74b-4685-ac36-da8054c8fe62 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:06.549286 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c9700a77-c74b-4685-ac36-da8054c8fe62 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:06.555232 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c9700a77-c74b-4685-ac36-da8054c8fe62 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:06.555719 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c9700a77-c74b-4685-ac36-da8054c8fe62 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:06.556255 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c9700a77-c74b-4685-ac36-da8054c8fe62 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:06.557145 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c9700a77-c74b-4685-ac36-da8054c8fe62 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:06.557644 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c9700a77-c74b-4685-ac36-da8054c8fe62 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:06.558121 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c9700a77-c74b-4685-ac36-da8054c8fe62 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:06.614125 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-fe65b326-91ea-4522-a011-acdc7a34cd9a tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b1fea950d48ef9a55cded8ed172a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130966aabcc04fc98c9f5139f826e78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:06.625243 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-fe65b326-91ea-4522-a011-acdc7a34cd9a tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] 10.222.0.62 "GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926" status: 200 len: 1314 microversion: 2.1 time: 0.204591 Sep 01 16:37:06.626138 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 79/150] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:06 2022] GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:06.647273 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-103a4339-4d82-4b41-b1df-a29895789b88 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:06.650401 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-103a4339-4d82-4b41-b1df-a29895789b88 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:06.658859 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-103a4339-4d82-4b41-b1df-a29895789b88 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:06.659663 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-103a4339-4d82-4b41-b1df-a29895789b88 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:06.660352 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-103a4339-4d82-4b41-b1df-a29895789b88 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:06.661258 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-103a4339-4d82-4b41-b1df-a29895789b88 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:06.661910 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-103a4339-4d82-4b41-b1df-a29895789b88 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:06.662817 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-103a4339-4d82-4b41-b1df-a29895789b88 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:06.729094 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c9700a77-c74b-4685-ac36-da8054c8fe62 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:06.739459 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c9700a77-c74b-4685-ac36-da8054c8fe62 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1360 microversion: 2.1 time: 0.197313 Sep 01 16:37:06.740447 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 72/151] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:06 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1360 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:06.747834 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.objects.instance [None req-103a4339-4d82-4b41-b1df-a29895789b88 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lazy-loading 'flavor' on Instance uuid 3be929ac-f249-4540-9ff2-3519a68231ff {{(pid=127199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:37:06.806720 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=100 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:06.882682 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-103a4339-4d82-4b41-b1df-a29895789b88 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "POST /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff/action" status: 200 len: 32 microversion: 2.1 time: 0.240340 Sep 01 16:37:06.883597 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 80/152] 10.222.0.62 () {60 vars in 1278 bytes} [Thu Sep 1 16:37:06 2022] POST /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff/action => generated 32 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 16:37:06.893327 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f52005be-7260-44cb-bb26-a9fc577b0aac tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:06.893935 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f52005be-7260-44cb-bb26-a9fc577b0aac tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:06.900294 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f52005be-7260-44cb-bb26-a9fc577b0aac tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:06.900777 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f52005be-7260-44cb-bb26-a9fc577b0aac tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:06.901450 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f52005be-7260-44cb-bb26-a9fc577b0aac tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:06.902150 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f52005be-7260-44cb-bb26-a9fc577b0aac tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:06.902600 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f52005be-7260-44cb-bb26-a9fc577b0aac tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:06.903214 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f52005be-7260-44cb-bb26-a9fc577b0aac tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:07.063556 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-31ceef6f-9303-4139-bd8f-537440ec805f req-a5c82394-5739-4232-8bef-80cba625d938 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bd544a7-a62e-434f-a842-e6231482d926", "name": "network-vif-plugged", "status": "completed", "tag": "2b8edb3c-5370-457e-be23-aab3a6c7d12d"}, {"server_uuid": "5537b019-c314-4b22-bde4-b19b3641c648", "name": "network-vif-plugged", "status": "completed", "tag": "63af1365-37ee-4010-8c55-df1561b93a9a"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:07.097387 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-31ceef6f-9303-4139-bd8f-537440ec805f req-a5c82394-5739-4232-8bef-80cba625d938 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:07.100450 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f52005be-7260-44cb-bb26-a9fc577b0aac tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:07.102781 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-31ceef6f-9303-4139-bd8f-537440ec805f req-a5c82394-5739-4232-8bef-80cba625d938 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:07.103405 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-31ceef6f-9303-4139-bd8f-537440ec805f req-a5c82394-5739-4232-8bef-80cba625d938 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:07.106506 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=100 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:07.113423 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f52005be-7260-44cb-bb26-a9fc577b0aac tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1522 microversion: 2.1 time: 0.223966 Sep 01 16:37:07.114651 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 73/153] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:06 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:37:07.128745 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-31ceef6f-9303-4139-bd8f-537440ec805f req-a5c82394-5739-4232-8bef-80cba625d938 service nova] Creating event network-vif-plugged:2b8edb3c-5370-457e-be23-aab3a6c7d12d for instance 5bd544a7-a62e-434f-a842-e6231482d926 on hv-cinder-85221 Sep 01 16:37:07.129488 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-31ceef6f-9303-4139-bd8f-537440ec805f req-a5c82394-5739-4232-8bef-80cba625d938 service nova] Creating event network-vif-plugged:63af1365-37ee-4010-8c55-df1561b93a9a for instance 5537b019-c314-4b22-bde4-b19b3641c648 on hv-cinder-85221 Sep 01 16:37:07.137762 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-31ceef6f-9303-4139-bd8f-537440ec805f req-a5c82394-5739-4232-8bef-80cba625d938 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.078779 Sep 01 16:37:07.143473 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 81/154] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:37:07.205442 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8936008a-49df-41ff-97db-be62db5102b6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:07.206904 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8936008a-49df-41ff-97db-be62db5102b6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:07.216198 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8936008a-49df-41ff-97db-be62db5102b6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:07.216871 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8936008a-49df-41ff-97db-be62db5102b6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:07.217484 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8936008a-49df-41ff-97db-be62db5102b6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:07.218192 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8936008a-49df-41ff-97db-be62db5102b6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:07.218653 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8936008a-49df-41ff-97db-be62db5102b6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:07.219065 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8936008a-49df-41ff-97db-be62db5102b6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:07.440988 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-9c5a4f7f-2f29-4529-bf49-b5f7c923aed2 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:07.441765 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-9c5a4f7f-2f29-4529-bf49-b5f7c923aed2 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: b16ceffd-c9b2-49e6-a44d-7353a17f230a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:07.455137 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9c5a4f7f-2f29-4529-bf49-b5f7c923aed2 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:07.456699 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9c5a4f7f-2f29-4529-bf49-b5f7c923aed2 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:07.457822 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9c5a4f7f-2f29-4529-bf49-b5f7c923aed2 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:07.460141 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9c5a4f7f-2f29-4529-bf49-b5f7c923aed2 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:07.462010 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9c5a4f7f-2f29-4529-bf49-b5f7c923aed2 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:07.462786 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8936008a-49df-41ff-97db-be62db5102b6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:07.463407 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9c5a4f7f-2f29-4529-bf49-b5f7c923aed2 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:07.472103 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8936008a-49df-41ff-97db-be62db5102b6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:07.475922 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8936008a-49df-41ff-97db-be62db5102b6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:07.481626 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8936008a-49df-41ff-97db-be62db5102b6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1407 microversion: 2.20 time: 0.280573 Sep 01 16:37:07.482681 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 74/155] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:07 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1407 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:07.646800 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f666db68-fe8a-4506-a375-4ca6ec07eabd tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:07.647684 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f666db68-fe8a-4506-a375-4ca6ec07eabd tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] [instance: 5bd544a7-a62e-434f-a842-e6231482d926] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:07.657281 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f666db68-fe8a-4506-a375-4ca6ec07eabd tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:07.659557 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f666db68-fe8a-4506-a375-4ca6ec07eabd tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:07.662452 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f666db68-fe8a-4506-a375-4ca6ec07eabd tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:07.663494 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f666db68-fe8a-4506-a375-4ca6ec07eabd tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:07.665381 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f666db68-fe8a-4506-a375-4ca6ec07eabd tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:07.666151 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f666db68-fe8a-4506-a375-4ca6ec07eabd tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:07.844525 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-9c5a4f7f-2f29-4529-bf49-b5f7c923aed2 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:07.854836 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-9c5a4f7f-2f29-4529-bf49-b5f7c923aed2 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a" status: 200 len: 1366 microversion: 2.1 time: 0.419709 Sep 01 16:37:07.864610 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 82/156] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:07 2022] GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a => generated 1366 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:07.903570 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ac59ea7b-b696-4e1f-adbb-77dfd6a0dad7 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:07.905048 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ac59ea7b-b696-4e1f-adbb-77dfd6a0dad7 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:07.925598 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac59ea7b-b696-4e1f-adbb-77dfd6a0dad7 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:07.926095 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac59ea7b-b696-4e1f-adbb-77dfd6a0dad7 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:07.928868 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac59ea7b-b696-4e1f-adbb-77dfd6a0dad7 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:07.929613 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac59ea7b-b696-4e1f-adbb-77dfd6a0dad7 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:07.930061 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac59ea7b-b696-4e1f-adbb-77dfd6a0dad7 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:07.930474 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac59ea7b-b696-4e1f-adbb-77dfd6a0dad7 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:08.459783 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f666db68-fe8a-4506-a375-4ca6ec07eabd tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b1fea950d48ef9a55cded8ed172a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130966aabcc04fc98c9f5139f826e78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:08.469510 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f666db68-fe8a-4506-a375-4ca6ec07eabd tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] 10.222.0.62 "GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926" status: 200 len: 1314 microversion: 2.1 time: 0.826572 Sep 01 16:37:08.470090 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 75/157] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:07 2022] GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926 => generated 1314 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:08.485074 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-01227900-1c1d-4794-804a-565fa141c705 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:08.485785 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-01227900-1c1d-4794-804a-565fa141c705 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:08.505146 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-01227900-1c1d-4794-804a-565fa141c705 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:08.506157 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-01227900-1c1d-4794-804a-565fa141c705 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:08.506869 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-01227900-1c1d-4794-804a-565fa141c705 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:08.507726 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-01227900-1c1d-4794-804a-565fa141c705 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:08.508763 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-01227900-1c1d-4794-804a-565fa141c705 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:08.509782 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-01227900-1c1d-4794-804a-565fa141c705 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:08.728056 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ac59ea7b-b696-4e1f-adbb-77dfd6a0dad7 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:08.739230 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ac59ea7b-b696-4e1f-adbb-77dfd6a0dad7 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1547 microversion: 2.1 time: 0.865117 Sep 01 16:37:08.740511 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 83/158] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:07 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1547 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:08.762863 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d76c3122-5030-49d4-aef2-3c349a0fac79 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:08.764778 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d76c3122-5030-49d4-aef2-3c349a0fac79 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:08.772704 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d76c3122-5030-49d4-aef2-3c349a0fac79 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:08.773486 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d76c3122-5030-49d4-aef2-3c349a0fac79 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:08.774194 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d76c3122-5030-49d4-aef2-3c349a0fac79 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:08.775202 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d76c3122-5030-49d4-aef2-3c349a0fac79 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:08.776628 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d76c3122-5030-49d4-aef2-3c349a0fac79 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:08.777165 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d76c3122-5030-49d4-aef2-3c349a0fac79 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:08.817641 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-01227900-1c1d-4794-804a-565fa141c705 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:08.829351 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-01227900-1c1d-4794-804a-565fa141c705 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1522 microversion: 2.1 time: 0.356155 Sep 01 16:37:08.829351 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 76/159] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:08 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1522 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:08.832948 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-981cc9b4-4808-495e-a78a-5c46eca9916e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:08.833429 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-981cc9b4-4808-495e-a78a-5c46eca9916e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:08.839292 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-981cc9b4-4808-495e-a78a-5c46eca9916e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:08.839996 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-981cc9b4-4808-495e-a78a-5c46eca9916e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:08.840653 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-981cc9b4-4808-495e-a78a-5c46eca9916e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:08.841601 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-981cc9b4-4808-495e-a78a-5c46eca9916e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:08.842348 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-981cc9b4-4808-495e-a78a-5c46eca9916e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:08.842931 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-981cc9b4-4808-495e-a78a-5c46eca9916e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:08.991881 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d76c3122-5030-49d4-aef2-3c349a0fac79 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:08.991881 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d76c3122-5030-49d4-aef2-3c349a0fac79 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:08.993236 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d76c3122-5030-49d4-aef2-3c349a0fac79 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:08.997633 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-981cc9b4-4808-495e-a78a-5c46eca9916e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.168301 Sep 01 16:37:08.998340 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 77/160] 10.222.0.62 () {58 vars in 1275 bytes} [Thu Sep 1 16:37:08 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037/os-interface => generated 285 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:37:08.998456 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d76c3122-5030-49d4-aef2-3c349a0fac79 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1407 microversion: 2.20 time: 0.256695 Sep 01 16:37:09.003678 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 84/161] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:08 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1407 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:09.017919 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1ad8b30d-3dcb-4be4-baac-67d642788885 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:09.018531 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1ad8b30d-3dcb-4be4-baac-67d642788885 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: b16ceffd-c9b2-49e6-a44d-7353a17f230a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:09.025605 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1ad8b30d-3dcb-4be4-baac-67d642788885 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:09.026088 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1ad8b30d-3dcb-4be4-baac-67d642788885 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:09.026960 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1ad8b30d-3dcb-4be4-baac-67d642788885 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:09.027661 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1ad8b30d-3dcb-4be4-baac-67d642788885 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:09.028152 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1ad8b30d-3dcb-4be4-baac-67d642788885 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:09.028570 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1ad8b30d-3dcb-4be4-baac-67d642788885 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:09.157402 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-134b6940-6f5c-4f97-863c-0896c26f7dfc req-fcdd393f-7159-4f6e-a9cb-87d53e9a4621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ddc2614-8a62-4c61-a086-8dbab65e1f4a", "name": "network-vif-plugged", "status": "completed", "tag": "9d73b218-5a3f-4e30-9685-717b1fbfe797"}, {"server_uuid": "b16ceffd-c9b2-49e6-a44d-7353a17f230a", "name": "network-vif-plugged", "status": "completed", "tag": "b4253844-4c55-43ea-a36b-20d7a499e811"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:09.176621 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-134b6940-6f5c-4f97-863c-0896c26f7dfc req-fcdd393f-7159-4f6e-a9cb-87d53e9a4621 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:09.177090 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-134b6940-6f5c-4f97-863c-0896c26f7dfc req-fcdd393f-7159-4f6e-a9cb-87d53e9a4621 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:09.177515 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-134b6940-6f5c-4f97-863c-0896c26f7dfc req-fcdd393f-7159-4f6e-a9cb-87d53e9a4621 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:09.208974 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1ad8b30d-3dcb-4be4-baac-67d642788885 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:09.213643 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-134b6940-6f5c-4f97-863c-0896c26f7dfc req-fcdd393f-7159-4f6e-a9cb-87d53e9a4621 service nova] Creating event network-vif-plugged:9d73b218-5a3f-4e30-9685-717b1fbfe797 for instance 8ddc2614-8a62-4c61-a086-8dbab65e1f4a on hv-cinder-85221 Sep 01 16:37:09.214363 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-134b6940-6f5c-4f97-863c-0896c26f7dfc req-fcdd393f-7159-4f6e-a9cb-87d53e9a4621 service nova] Creating event network-vif-plugged:b4253844-4c55-43ea-a36b-20d7a499e811 for instance b16ceffd-c9b2-49e6-a44d-7353a17f230a on hv-cinder-85221 Sep 01 16:37:09.217861 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1ad8b30d-3dcb-4be4-baac-67d642788885 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a" status: 200 len: 1366 microversion: 2.1 time: 0.212930 Sep 01 16:37:09.220283 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 78/162] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:08 2022] GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:09.233263 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-134b6940-6f5c-4f97-863c-0896c26f7dfc req-fcdd393f-7159-4f6e-a9cb-87d53e9a4621 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.079560 Sep 01 16:37:09.234101 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 85/163] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:37:09.492873 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a75002fa-d992-4ee1-b1e2-155ceda2c246 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:09.494600 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a75002fa-d992-4ee1-b1e2-155ceda2c246 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] [instance: 5bd544a7-a62e-434f-a842-e6231482d926] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:09.501690 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a75002fa-d992-4ee1-b1e2-155ceda2c246 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:09.502166 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a75002fa-d992-4ee1-b1e2-155ceda2c246 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:09.502888 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a75002fa-d992-4ee1-b1e2-155ceda2c246 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:09.503643 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a75002fa-d992-4ee1-b1e2-155ceda2c246 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:09.504202 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a75002fa-d992-4ee1-b1e2-155ceda2c246 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:09.504918 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a75002fa-d992-4ee1-b1e2-155ceda2c246 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:09.659730 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a75002fa-d992-4ee1-b1e2-155ceda2c246 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b1fea950d48ef9a55cded8ed172a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130966aabcc04fc98c9f5139f826e78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:09.668489 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a75002fa-d992-4ee1-b1e2-155ceda2c246 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] 10.222.0.62 "GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926" status: 200 len: 1314 microversion: 2.1 time: 0.180421 Sep 01 16:37:09.669327 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 79/164] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:09 2022] GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:09.849188 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-400cb661-0db5-4319-9c71-f856f6fab784 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:09.850645 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-400cb661-0db5-4319-9c71-f856f6fab784 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:09.857470 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-400cb661-0db5-4319-9c71-f856f6fab784 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:09.858161 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-400cb661-0db5-4319-9c71-f856f6fab784 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:09.858863 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-400cb661-0db5-4319-9c71-f856f6fab784 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:09.859798 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-400cb661-0db5-4319-9c71-f856f6fab784 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:09.860579 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-400cb661-0db5-4319-9c71-f856f6fab784 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:09.861315 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-400cb661-0db5-4319-9c71-f856f6fab784 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:10.020801 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-64c0f369-9018-4445-95eb-f376f15c2932 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:10.021603 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-64c0f369-9018-4445-95eb-f376f15c2932 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:10.033512 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-64c0f369-9018-4445-95eb-f376f15c2932 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:10.034218 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-64c0f369-9018-4445-95eb-f376f15c2932 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:10.036333 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-64c0f369-9018-4445-95eb-f376f15c2932 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:10.037225 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-64c0f369-9018-4445-95eb-f376f15c2932 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:10.041196 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-64c0f369-9018-4445-95eb-f376f15c2932 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:10.041645 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-64c0f369-9018-4445-95eb-f376f15c2932 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:10.093188 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-400cb661-0db5-4319-9c71-f856f6fab784 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:10.101674 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-400cb661-0db5-4319-9c71-f856f6fab784 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1522 microversion: 2.1 time: 0.256584 Sep 01 16:37:10.102250 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 86/165] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:09 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:10.240576 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0fd37d19-178d-4cbc-ab6f-01b6c663f68c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:10.241472 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-0fd37d19-178d-4cbc-ab6f-01b6c663f68c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: b16ceffd-c9b2-49e6-a44d-7353a17f230a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:10.252186 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=93 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:10.258349 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0fd37d19-178d-4cbc-ab6f-01b6c663f68c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:10.264188 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0fd37d19-178d-4cbc-ab6f-01b6c663f68c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:10.267157 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0fd37d19-178d-4cbc-ab6f-01b6c663f68c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:10.269440 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0fd37d19-178d-4cbc-ab6f-01b6c663f68c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:10.272378 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0fd37d19-178d-4cbc-ab6f-01b6c663f68c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:10.272498 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-64c0f369-9018-4445-95eb-f376f15c2932 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:10.273323 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0fd37d19-178d-4cbc-ab6f-01b6c663f68c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:10.289557 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-64c0f369-9018-4445-95eb-f376f15c2932 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:10.292712 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-64c0f369-9018-4445-95eb-f376f15c2932 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:10.294262 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-64c0f369-9018-4445-95eb-f376f15c2932 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1407 microversion: 2.20 time: 0.277073 Sep 01 16:37:10.294931 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 80/166] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:10 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:10.547269 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-0fd37d19-178d-4cbc-ab6f-01b6c663f68c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:10.576158 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-0fd37d19-178d-4cbc-ab6f-01b6c663f68c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a" status: 200 len: 1366 microversion: 2.1 time: 0.341225 Sep 01 16:37:10.577290 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 87/167] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:10 2022] GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a => generated 1366 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:37:10.693433 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-77481185-a224-4bff-8070-00b066387908 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:10.695212 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-77481185-a224-4bff-8070-00b066387908 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] [instance: 5bd544a7-a62e-434f-a842-e6231482d926] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:10.709328 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-77481185-a224-4bff-8070-00b066387908 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:10.710133 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-77481185-a224-4bff-8070-00b066387908 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:10.710571 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-77481185-a224-4bff-8070-00b066387908 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:10.711627 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-77481185-a224-4bff-8070-00b066387908 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:10.711711 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-77481185-a224-4bff-8070-00b066387908 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:10.712146 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-77481185-a224-4bff-8070-00b066387908 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:10.741751 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-863e52c0-7eac-4bd6-a241-3e2ac153b025 req-d6e88754-f000-443d-bc87-e5354ac853a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1bf96dd-b79a-403b-aa81-985c692df037", "tag": "89467631-d9b5-466b-89fd-219067a07f3e"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:10.753002 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-863e52c0-7eac-4bd6-a241-3e2ac153b025 req-d6e88754-f000-443d-bc87-e5354ac853a0 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:10.753895 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-863e52c0-7eac-4bd6-a241-3e2ac153b025 req-d6e88754-f000-443d-bc87-e5354ac853a0 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:10.754561 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-863e52c0-7eac-4bd6-a241-3e2ac153b025 req-d6e88754-f000-443d-bc87-e5354ac853a0 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:10.775080 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-863e52c0-7eac-4bd6-a241-3e2ac153b025 req-d6e88754-f000-443d-bc87-e5354ac853a0 service nova] Creating event network-changed:89467631-d9b5-466b-89fd-219067a07f3e for instance a1bf96dd-b79a-403b-aa81-985c692df037 on hv-cinder-85221 Sep 01 16:37:10.782887 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-863e52c0-7eac-4bd6-a241-3e2ac153b025 req-d6e88754-f000-443d-bc87-e5354ac853a0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044770 Sep 01 16:37:10.783750 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 88/168] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:37:11.126316 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c1eab27c-9d53-4cba-a323-205387bb3007 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:11.127018 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-c1eab27c-9d53-4cba-a323-205387bb3007 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:11.134793 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c1eab27c-9d53-4cba-a323-205387bb3007 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:11.135770 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c1eab27c-9d53-4cba-a323-205387bb3007 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:11.136273 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c1eab27c-9d53-4cba-a323-205387bb3007 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:11.137442 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c1eab27c-9d53-4cba-a323-205387bb3007 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:11.137442 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c1eab27c-9d53-4cba-a323-205387bb3007 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:11.137837 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c1eab27c-9d53-4cba-a323-205387bb3007 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:11.241203 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-77481185-a224-4bff-8070-00b066387908 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b1fea950d48ef9a55cded8ed172a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130966aabcc04fc98c9f5139f826e78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:11.250583 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-77481185-a224-4bff-8070-00b066387908 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] 10.222.0.62 "GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926" status: 200 len: 1502 microversion: 2.1 time: 0.562969 Sep 01 16:37:11.251189 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 81/169] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:10 2022] GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926 => generated 1502 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:11.326540 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8a68a234-4cfc-4d25-bf7f-13dcb116bca8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:11.327932 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8a68a234-4cfc-4d25-bf7f-13dcb116bca8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:11.350840 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8a68a234-4cfc-4d25-bf7f-13dcb116bca8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:11.350840 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8a68a234-4cfc-4d25-bf7f-13dcb116bca8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:11.350840 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8a68a234-4cfc-4d25-bf7f-13dcb116bca8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:11.350840 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8a68a234-4cfc-4d25-bf7f-13dcb116bca8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:11.351481 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8a68a234-4cfc-4d25-bf7f-13dcb116bca8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:11.351622 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8a68a234-4cfc-4d25-bf7f-13dcb116bca8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:11.708230 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c1eab27c-9d53-4cba-a323-205387bb3007 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:11.718556 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-c1eab27c-9d53-4cba-a323-205387bb3007 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1522 microversion: 2.1 time: 0.595666 Sep 01 16:37:11.719144 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 89/170] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:11 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1522 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:37:11.724824 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c7e29221-27e9-4526-9ee0-55dbfb9605b5 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:11.730965 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-c7e29221-27e9-4526-9ee0-55dbfb9605b5 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: b16ceffd-c9b2-49e6-a44d-7353a17f230a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:11.748759 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c7e29221-27e9-4526-9ee0-55dbfb9605b5 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:11.749714 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c7e29221-27e9-4526-9ee0-55dbfb9605b5 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:11.750292 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c7e29221-27e9-4526-9ee0-55dbfb9605b5 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:11.751178 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c7e29221-27e9-4526-9ee0-55dbfb9605b5 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:11.752682 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c7e29221-27e9-4526-9ee0-55dbfb9605b5 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:11.754025 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c7e29221-27e9-4526-9ee0-55dbfb9605b5 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:11.802201 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8a68a234-4cfc-4d25-bf7f-13dcb116bca8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:11.852942 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8a68a234-4cfc-4d25-bf7f-13dcb116bca8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:11.856716 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8a68a234-4cfc-4d25-bf7f-13dcb116bca8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:11.865660 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8a68a234-4cfc-4d25-bf7f-13dcb116bca8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1407 microversion: 2.20 time: 0.547055 Sep 01 16:37:11.877949 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 82/171] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:11 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1407 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:12.021915 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c7e29221-27e9-4526-9ee0-55dbfb9605b5 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:12.040800 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-c7e29221-27e9-4526-9ee0-55dbfb9605b5 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a" status: 200 len: 1366 microversion: 2.1 time: 0.319761 Sep 01 16:37:12.047997 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 90/172] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:11 2022] GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a => generated 1366 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:12.740734 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b03e9050-68f4-4dd0-9eab-2fda776bc088 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:12.741580 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b03e9050-68f4-4dd0-9eab-2fda776bc088 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:12.747632 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=99 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:12.749614 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b03e9050-68f4-4dd0-9eab-2fda776bc088 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:12.750386 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b03e9050-68f4-4dd0-9eab-2fda776bc088 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:12.751143 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b03e9050-68f4-4dd0-9eab-2fda776bc088 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:12.752191 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b03e9050-68f4-4dd0-9eab-2fda776bc088 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:12.752929 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b03e9050-68f4-4dd0-9eab-2fda776bc088 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:12.753569 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b03e9050-68f4-4dd0-9eab-2fda776bc088 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:12.904285 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-85263a25-996f-44aa-a6a3-6a1898869eea tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:12.906118 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-85263a25-996f-44aa-a6a3-6a1898869eea tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:12.914456 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-85263a25-996f-44aa-a6a3-6a1898869eea tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:12.915103 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-85263a25-996f-44aa-a6a3-6a1898869eea tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:12.915517 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-85263a25-996f-44aa-a6a3-6a1898869eea tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:12.916543 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-85263a25-996f-44aa-a6a3-6a1898869eea tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:12.917812 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-85263a25-996f-44aa-a6a3-6a1898869eea tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:12.918353 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-85263a25-996f-44aa-a6a3-6a1898869eea tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:13.050224 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b03e9050-68f4-4dd0-9eab-2fda776bc088 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:13.067233 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b03e9050-68f4-4dd0-9eab-2fda776bc088 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1522 microversion: 2.1 time: 0.325487 Sep 01 16:37:13.068379 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 83/173] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:12 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:13.096753 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3f9014e0-e55f-409a-ba9e-e1295fcdf37f tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "79722b09-733a-4827-8543-6757d5bfb85a"}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:13.100812 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-3f9014e0-e55f-409a-ba9e-e1295fcdf37f tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] [instance: 5bd544a7-a62e-434f-a842-e6231482d926] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:13.109467 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3f9014e0-e55f-409a-ba9e-e1295fcdf37f tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:13.110765 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3f9014e0-e55f-409a-ba9e-e1295fcdf37f tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:13.111433 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3f9014e0-e55f-409a-ba9e-e1295fcdf37f tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:13.112981 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3f9014e0-e55f-409a-ba9e-e1295fcdf37f tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:13.113838 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3f9014e0-e55f-409a-ba9e-e1295fcdf37f tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:13.114721 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3f9014e0-e55f-409a-ba9e-e1295fcdf37f tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:13.268657 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-85263a25-996f-44aa-a6a3-6a1898869eea tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:13.299088 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-85263a25-996f-44aa-a6a3-6a1898869eea tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:13.303219 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-85263a25-996f-44aa-a6a3-6a1898869eea tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:13.304967 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-85263a25-996f-44aa-a6a3-6a1898869eea tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1407 microversion: 2.20 time: 0.405679 Sep 01 16:37:13.306633 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 91/174] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:12 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1407 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:37:13.319175 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-9f8d72e1-93f7-4bcf-ab82-bab325ff31e5 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:13.319799 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-9f8d72e1-93f7-4bcf-ab82-bab325ff31e5 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: b16ceffd-c9b2-49e6-a44d-7353a17f230a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:13.342173 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9f8d72e1-93f7-4bcf-ab82-bab325ff31e5 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:13.342834 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9f8d72e1-93f7-4bcf-ab82-bab325ff31e5 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:13.343845 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9f8d72e1-93f7-4bcf-ab82-bab325ff31e5 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:13.346192 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9f8d72e1-93f7-4bcf-ab82-bab325ff31e5 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:13.347781 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9f8d72e1-93f7-4bcf-ab82-bab325ff31e5 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:13.349159 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9f8d72e1-93f7-4bcf-ab82-bab325ff31e5 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:13.606720 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-9f8d72e1-93f7-4bcf-ab82-bab325ff31e5 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:13.620161 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-9f8d72e1-93f7-4bcf-ab82-bab325ff31e5 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a" status: 200 len: 1556 microversion: 2.1 time: 0.312110 Sep 01 16:37:13.652121 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 92/175] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:13 2022] GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a => generated 1556 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:13.672723 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-1023d599-0303-4056-a105-01aeecbbecfe tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:13.674889 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-1023d599-0303-4056-a105-01aeecbbecfe tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: b16ceffd-c9b2-49e6-a44d-7353a17f230a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:13.694885 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1023d599-0303-4056-a105-01aeecbbecfe tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:13.695686 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1023d599-0303-4056-a105-01aeecbbecfe tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:13.697908 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1023d599-0303-4056-a105-01aeecbbecfe tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:13.699178 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1023d599-0303-4056-a105-01aeecbbecfe tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:13.701216 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1023d599-0303-4056-a105-01aeecbbecfe tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:13.702542 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1023d599-0303-4056-a105-01aeecbbecfe tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:13.839339 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-1023d599-0303-4056-a105-01aeecbbecfe tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.184650 Sep 01 16:37:13.839986 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 93/176] 10.222.0.62 () {58 vars in 1275 bytes} [Thu Sep 1 16:37:13 2022] GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a/os-interface => generated 284 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:37:14.094703 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-dcaeda3a-ff9b-4277-8361-a08ac3038e71 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:14.095945 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-dcaeda3a-ff9b-4277-8361-a08ac3038e71 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:14.113647 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dcaeda3a-ff9b-4277-8361-a08ac3038e71 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:14.115367 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dcaeda3a-ff9b-4277-8361-a08ac3038e71 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:14.116108 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dcaeda3a-ff9b-4277-8361-a08ac3038e71 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:14.117294 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dcaeda3a-ff9b-4277-8361-a08ac3038e71 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:14.118334 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dcaeda3a-ff9b-4277-8361-a08ac3038e71 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:14.119316 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dcaeda3a-ff9b-4277-8361-a08ac3038e71 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:14.428967 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3f9014e0-e55f-409a-ba9e-e1295fcdf37f tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] 10.222.0.62 "POST /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.358490 Sep 01 16:37:14.429738 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 84/177] 10.222.0.62 () {60 vars in 1323 bytes} [Thu Sep 1 16:37:13 2022] POST /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926/os-volume_attachments => generated 194 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:37:14.483586 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b974e54e-9277-429c-a953-8e720e17610f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:14.483586 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b974e54e-9277-429c-a953-8e720e17610f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:14.509869 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b974e54e-9277-429c-a953-8e720e17610f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:14.510387 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b974e54e-9277-429c-a953-8e720e17610f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:14.515030 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b974e54e-9277-429c-a953-8e720e17610f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:14.517865 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b974e54e-9277-429c-a953-8e720e17610f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:14.518502 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b974e54e-9277-429c-a953-8e720e17610f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:14.519210 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b974e54e-9277-429c-a953-8e720e17610f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:14.910043 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b974e54e-9277-429c-a953-8e720e17610f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:14.929313 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b974e54e-9277-429c-a953-8e720e17610f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:14.930772 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b974e54e-9277-429c-a953-8e720e17610f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:14.932016 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b974e54e-9277-429c-a953-8e720e17610f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1600 microversion: 2.20 time: 0.465348 Sep 01 16:37:14.933354 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 85/178] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:14 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1600 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:14.955996 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-dcaeda3a-ff9b-4277-8361-a08ac3038e71 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:14.965047 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7bcd05b5-9358-4b7b-af4a-cb5dd8e52405 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:14.965967 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7bcd05b5-9358-4b7b-af4a-cb5dd8e52405 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:14.973986 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-dcaeda3a-ff9b-4277-8361-a08ac3038e71 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1522 microversion: 2.1 time: 0.883233 Sep 01 16:37:14.977808 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7bcd05b5-9358-4b7b-af4a-cb5dd8e52405 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:14.989761 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7bcd05b5-9358-4b7b-af4a-cb5dd8e52405 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:14.993572 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 94/179] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:14 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1522 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:37:14.994429 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7bcd05b5-9358-4b7b-af4a-cb5dd8e52405 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:14.995623 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7bcd05b5-9358-4b7b-af4a-cb5dd8e52405 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:14.996374 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7bcd05b5-9358-4b7b-af4a-cb5dd8e52405 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:14.996983 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7bcd05b5-9358-4b7b-af4a-cb5dd8e52405 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:15.188704 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7bcd05b5-9358-4b7b-af4a-cb5dd8e52405 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.228059 Sep 01 16:37:15.190579 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 86/180] 10.222.0.62 () {60 vars in 1316 bytes} [Thu Sep 1 16:37:14 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a/os-interface => generated 285 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:37:16.002669 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-5117cdbc-dd28-4344-8caa-895d9990f463 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:16.003366 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-5117cdbc-dd28-4344-8caa-895d9990f463 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:16.009906 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5117cdbc-dd28-4344-8caa-895d9990f463 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:16.010650 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5117cdbc-dd28-4344-8caa-895d9990f463 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:16.011330 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5117cdbc-dd28-4344-8caa-895d9990f463 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:16.013821 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5117cdbc-dd28-4344-8caa-895d9990f463 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:16.015829 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5117cdbc-dd28-4344-8caa-895d9990f463 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:16.016603 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5117cdbc-dd28-4344-8caa-895d9990f463 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:16.033771 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-45fb64d7-f0df-43fc-9e9d-4e09db9c0582 req-193ba200-fe9e-434c-9a92-4c92ab80fb14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b16ceffd-c9b2-49e6-a44d-7353a17f230a", "tag": "b4253844-4c55-43ea-a36b-20d7a499e811"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:16.047362 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-45fb64d7-f0df-43fc-9e9d-4e09db9c0582 req-193ba200-fe9e-434c-9a92-4c92ab80fb14 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:16.047872 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-45fb64d7-f0df-43fc-9e9d-4e09db9c0582 req-193ba200-fe9e-434c-9a92-4c92ab80fb14 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:16.048397 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-45fb64d7-f0df-43fc-9e9d-4e09db9c0582 req-193ba200-fe9e-434c-9a92-4c92ab80fb14 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:16.076647 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-45fb64d7-f0df-43fc-9e9d-4e09db9c0582 req-193ba200-fe9e-434c-9a92-4c92ab80fb14 service nova] Creating event network-changed:b4253844-4c55-43ea-a36b-20d7a499e811 for instance b16ceffd-c9b2-49e6-a44d-7353a17f230a on hv-cinder-85221 Sep 01 16:37:16.091495 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-45fb64d7-f0df-43fc-9e9d-4e09db9c0582 req-193ba200-fe9e-434c-9a92-4c92ab80fb14 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060037 Sep 01 16:37:16.093834 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 87/181] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:37:16.371969 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-5117cdbc-dd28-4344-8caa-895d9990f463 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:16.384353 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-5117cdbc-dd28-4344-8caa-895d9990f463 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1522 microversion: 2.1 time: 0.385868 Sep 01 16:37:16.402089 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 95/182] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:15 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1522 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:17.351775 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-4427f0d9-9806-45c2-b09d-f582b290205e req-f1949d95-6db5-4ed1-839c-62d6068e7214 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ddc2614-8a62-4c61-a086-8dbab65e1f4a", "tag": "9d73b218-5a3f-4e30-9685-717b1fbfe797"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:17.386385 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-4427f0d9-9806-45c2-b09d-f582b290205e req-f1949d95-6db5-4ed1-839c-62d6068e7214 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:17.388163 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-4427f0d9-9806-45c2-b09d-f582b290205e req-f1949d95-6db5-4ed1-839c-62d6068e7214 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:17.388990 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-4427f0d9-9806-45c2-b09d-f582b290205e req-f1949d95-6db5-4ed1-839c-62d6068e7214 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:17.408539 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-4427f0d9-9806-45c2-b09d-f582b290205e req-f1949d95-6db5-4ed1-839c-62d6068e7214 service nova] Creating event network-changed:9d73b218-5a3f-4e30-9685-717b1fbfe797 for instance 8ddc2614-8a62-4c61-a086-8dbab65e1f4a on hv-cinder-85221 Sep 01 16:37:17.412782 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-27cab1a8-2a95-42f7-a05a-07469bd92e08 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:17.413462 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-27cab1a8-2a95-42f7-a05a-07469bd92e08 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:17.417638 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-4427f0d9-9806-45c2-b09d-f582b290205e req-f1949d95-6db5-4ed1-839c-62d6068e7214 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079038 Sep 01 16:37:17.419173 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 88/183] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:37:17.441305 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-27cab1a8-2a95-42f7-a05a-07469bd92e08 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:17.442152 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-27cab1a8-2a95-42f7-a05a-07469bd92e08 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:17.442796 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-27cab1a8-2a95-42f7-a05a-07469bd92e08 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:17.443685 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-27cab1a8-2a95-42f7-a05a-07469bd92e08 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:17.444339 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-27cab1a8-2a95-42f7-a05a-07469bd92e08 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:17.444963 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-27cab1a8-2a95-42f7-a05a-07469bd92e08 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:17.937890 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-27cab1a8-2a95-42f7-a05a-07469bd92e08 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:17.957581 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-27cab1a8-2a95-42f7-a05a-07469bd92e08 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1522 microversion: 2.1 time: 0.547005 Sep 01 16:37:17.958214 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 96/184] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:17 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1522 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:37:18.981277 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b1159f67-f027-4b02-a462-613cde940d87 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:18.982589 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b1159f67-f027-4b02-a462-613cde940d87 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:18.995867 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b1159f67-f027-4b02-a462-613cde940d87 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:18.998828 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b1159f67-f027-4b02-a462-613cde940d87 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:19.000352 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b1159f67-f027-4b02-a462-613cde940d87 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:19.001594 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b1159f67-f027-4b02-a462-613cde940d87 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:19.003583 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b1159f67-f027-4b02-a462-613cde940d87 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:19.006278 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b1159f67-f027-4b02-a462-613cde940d87 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:19.420132 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b1159f67-f027-4b02-a462-613cde940d87 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:19.437656 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b1159f67-f027-4b02-a462-613cde940d87 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1522 microversion: 2.1 time: 0.462070 Sep 01 16:37:19.446647 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 89/185] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:18 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1522 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:37:20.467349 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a01b2d7d-8520-4007-b0fa-4766d94ef948 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:20.467956 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-a01b2d7d-8520-4007-b0fa-4766d94ef948 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:20.474377 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a01b2d7d-8520-4007-b0fa-4766d94ef948 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:20.474900 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a01b2d7d-8520-4007-b0fa-4766d94ef948 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:20.475338 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a01b2d7d-8520-4007-b0fa-4766d94ef948 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:20.476119 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a01b2d7d-8520-4007-b0fa-4766d94ef948 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:20.476527 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a01b2d7d-8520-4007-b0fa-4766d94ef948 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:20.476952 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a01b2d7d-8520-4007-b0fa-4766d94ef948 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:20.639575 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-a01b2d7d-8520-4007-b0fa-4766d94ef948 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:20.648347 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-a01b2d7d-8520-4007-b0fa-4766d94ef948 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1522 microversion: 2.1 time: 0.185206 Sep 01 16:37:20.649040 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 97/186] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:20 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:21.673416 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-909d720d-d593-4a1b-940c-8eb3ac063b31 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:21.674163 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-909d720d-d593-4a1b-940c-8eb3ac063b31 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:21.681386 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-909d720d-d593-4a1b-940c-8eb3ac063b31 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:21.681881 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-909d720d-d593-4a1b-940c-8eb3ac063b31 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:21.682380 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-909d720d-d593-4a1b-940c-8eb3ac063b31 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:21.683052 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-909d720d-d593-4a1b-940c-8eb3ac063b31 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:21.683946 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-909d720d-d593-4a1b-940c-8eb3ac063b31 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:21.684622 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-909d720d-d593-4a1b-940c-8eb3ac063b31 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:21.859379 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-909d720d-d593-4a1b-940c-8eb3ac063b31 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:21.867530 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-909d720d-d593-4a1b-940c-8eb3ac063b31 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1522 microversion: 2.1 time: 0.198124 Sep 01 16:37:21.873045 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 90/187] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:21 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:22.890562 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8517721d-bdf5-46a2-9080-df3a55a862fd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:22.891759 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-8517721d-bdf5-46a2-9080-df3a55a862fd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:22.898507 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8517721d-bdf5-46a2-9080-df3a55a862fd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:22.899360 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8517721d-bdf5-46a2-9080-df3a55a862fd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:22.900159 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8517721d-bdf5-46a2-9080-df3a55a862fd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:22.901231 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8517721d-bdf5-46a2-9080-df3a55a862fd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:22.910664 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8517721d-bdf5-46a2-9080-df3a55a862fd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:22.911117 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8517721d-bdf5-46a2-9080-df3a55a862fd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:22.917116 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:23.169859 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8517721d-bdf5-46a2-9080-df3a55a862fd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:23.184450 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8517721d-bdf5-46a2-9080-df3a55a862fd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1522 microversion: 2.1 time: 0.293471 Sep 01 16:37:23.185536 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 98/188] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:22 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:23.979295 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-55c52725-ff82-4ca2-b9be-db20c39d9ddb tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:23.979777 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-55c52725-ff82-4ca2-b9be-db20c39d9ddb tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] [instance: 5bd544a7-a62e-434f-a842-e6231482d926] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:23.986847 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-55c52725-ff82-4ca2-b9be-db20c39d9ddb tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:24.002385 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-55c52725-ff82-4ca2-b9be-db20c39d9ddb tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:24.003203 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-55c52725-ff82-4ca2-b9be-db20c39d9ddb tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:24.006088 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-55c52725-ff82-4ca2-b9be-db20c39d9ddb tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:24.011621 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-55c52725-ff82-4ca2-b9be-db20c39d9ddb tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:24.012448 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-55c52725-ff82-4ca2-b9be-db20c39d9ddb tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:24.067794 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:24.081083 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-55c52725-ff82-4ca2-b9be-db20c39d9ddb tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] [instance: 5bd544a7-a62e-434f-a842-e6231482d926] Going to try to terminate instance {{(pid=127198) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:37:24.214127 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-307962e9-04bc-4b7b-a353-ab1b932548eb tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:24.214961 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-307962e9-04bc-4b7b-a353-ab1b932548eb tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:24.236468 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-307962e9-04bc-4b7b-a353-ab1b932548eb tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:24.247247 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-307962e9-04bc-4b7b-a353-ab1b932548eb tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:24.248047 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-307962e9-04bc-4b7b-a353-ab1b932548eb tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:24.248957 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-307962e9-04bc-4b7b-a353-ab1b932548eb tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:24.249565 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-307962e9-04bc-4b7b-a353-ab1b932548eb tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:24.250133 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-307962e9-04bc-4b7b-a353-ab1b932548eb tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:24.437714 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-55c52725-ff82-4ca2-b9be-db20c39d9ddb tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] 10.222.0.62 "DELETE /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926" status: 204 len: 0 microversion: 2.1 time: 0.462131 Sep 01 16:37:24.441871 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 91/189] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Sep 1 16:37:23 2022] DELETE /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:37:24.458955 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-32c7da32-2cd7-47b5-a0c3-60ca8bb1f020 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:24.460009 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-32c7da32-2cd7-47b5-a0c3-60ca8bb1f020 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] [instance: 5bd544a7-a62e-434f-a842-e6231482d926] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:24.484079 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-32c7da32-2cd7-47b5-a0c3-60ca8bb1f020 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:24.486167 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-32c7da32-2cd7-47b5-a0c3-60ca8bb1f020 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:24.486935 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-32c7da32-2cd7-47b5-a0c3-60ca8bb1f020 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:24.496184 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-32c7da32-2cd7-47b5-a0c3-60ca8bb1f020 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:24.497932 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-32c7da32-2cd7-47b5-a0c3-60ca8bb1f020 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:24.498457 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-32c7da32-2cd7-47b5-a0c3-60ca8bb1f020 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:24.805483 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-307962e9-04bc-4b7b-a353-ab1b932548eb tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:24.822106 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-307962e9-04bc-4b7b-a353-ab1b932548eb tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1522 microversion: 2.1 time: 0.612434 Sep 01 16:37:24.835022 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 99/190] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:24 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1522 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:24.849709 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-32c7da32-2cd7-47b5-a0c3-60ca8bb1f020 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b1fea950d48ef9a55cded8ed172a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130966aabcc04fc98c9f5139f826e78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:24.867973 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-32c7da32-2cd7-47b5-a0c3-60ca8bb1f020 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] 10.222.0.62 "GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926" status: 200 len: 1554 microversion: 2.1 time: 0.415894 Sep 01 16:37:24.870089 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 92/191] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:24 2022] GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926 => generated 1554 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:25.861172 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-021cfe70-80a7-44e8-8f41-197e2b6be029 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:25.863242 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-021cfe70-80a7-44e8-8f41-197e2b6be029 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:25.875534 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-021cfe70-80a7-44e8-8f41-197e2b6be029 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:25.876448 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-021cfe70-80a7-44e8-8f41-197e2b6be029 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:25.877255 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-021cfe70-80a7-44e8-8f41-197e2b6be029 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:25.878204 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-021cfe70-80a7-44e8-8f41-197e2b6be029 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:25.878846 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-021cfe70-80a7-44e8-8f41-197e2b6be029 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:25.879825 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-021cfe70-80a7-44e8-8f41-197e2b6be029 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:25.890241 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d6747cad-7283-4f05-92d4-3b900abc8d9b tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:25.891537 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d6747cad-7283-4f05-92d4-3b900abc8d9b tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] [instance: 5bd544a7-a62e-434f-a842-e6231482d926] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:25.901668 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d6747cad-7283-4f05-92d4-3b900abc8d9b tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:25.906095 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d6747cad-7283-4f05-92d4-3b900abc8d9b tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:25.907821 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d6747cad-7283-4f05-92d4-3b900abc8d9b tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:25.907821 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d6747cad-7283-4f05-92d4-3b900abc8d9b tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:25.908843 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d6747cad-7283-4f05-92d4-3b900abc8d9b tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:25.908843 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d6747cad-7283-4f05-92d4-3b900abc8d9b tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:26.347126 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d6747cad-7283-4f05-92d4-3b900abc8d9b tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b1fea950d48ef9a55cded8ed172a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130966aabcc04fc98c9f5139f826e78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:26.354999 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-021cfe70-80a7-44e8-8f41-197e2b6be029 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:26.357151 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d6747cad-7283-4f05-92d4-3b900abc8d9b tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] 10.222.0.62 "GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926" status: 200 len: 1554 microversion: 2.1 time: 0.471587 Sep 01 16:37:26.360529 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 93/192] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:25 2022] GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926 => generated 1554 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:37:26.395331 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-021cfe70-80a7-44e8-8f41-197e2b6be029 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1522 microversion: 2.1 time: 0.541445 Sep 01 16:37:26.395992 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 100/193] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:25 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1522 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:27.390048 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-fbb184bb-ceb7-476c-bcb8-62b79b0a50c4 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:27.390721 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-fbb184bb-ceb7-476c-bcb8-62b79b0a50c4 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] [instance: 5bd544a7-a62e-434f-a842-e6231482d926] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:27.412583 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fbb184bb-ceb7-476c-bcb8-62b79b0a50c4 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:27.415695 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fbb184bb-ceb7-476c-bcb8-62b79b0a50c4 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:27.416617 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fbb184bb-ceb7-476c-bcb8-62b79b0a50c4 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:27.417885 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fbb184bb-ceb7-476c-bcb8-62b79b0a50c4 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:27.418169 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c78039c7-5490-4170-b04c-50404896e1e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:27.418855 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-c78039c7-5490-4170-b04c-50404896e1e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:27.419391 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fbb184bb-ceb7-476c-bcb8-62b79b0a50c4 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:27.420692 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fbb184bb-ceb7-476c-bcb8-62b79b0a50c4 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:27.435470 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c78039c7-5490-4170-b04c-50404896e1e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:27.436145 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c78039c7-5490-4170-b04c-50404896e1e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:27.436606 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c78039c7-5490-4170-b04c-50404896e1e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:27.439190 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c78039c7-5490-4170-b04c-50404896e1e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:27.440733 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c78039c7-5490-4170-b04c-50404896e1e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:27.443102 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c78039c7-5490-4170-b04c-50404896e1e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:27.789989 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c78039c7-5490-4170-b04c-50404896e1e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:27.800249 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-c78039c7-5490-4170-b04c-50404896e1e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1522 microversion: 2.1 time: 0.386807 Sep 01 16:37:27.801197 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 101/194] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:27 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1522 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:27.882388 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-fbb184bb-ceb7-476c-bcb8-62b79b0a50c4 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b1fea950d48ef9a55cded8ed172a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130966aabcc04fc98c9f5139f826e78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:27.905150 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-fbb184bb-ceb7-476c-bcb8-62b79b0a50c4 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] 10.222.0.62 "GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926" status: 200 len: 1554 microversion: 2.1 time: 0.529238 Sep 01 16:37:27.915914 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 94/195] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:27 2022] GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926 => generated 1554 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:27.960833 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-6d7c618a-c7f7-4a29-833e-42ea11842c30 req-c758405e-88c9-4391-8176-5428a6839c4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bd544a7-a62e-434f-a842-e6231482d926", "name": "network-vif-deleted", "tag": "2b8edb3c-5370-457e-be23-aab3a6c7d12d"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:27.973658 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-6d7c618a-c7f7-4a29-833e-42ea11842c30 req-c758405e-88c9-4391-8176-5428a6839c4f service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:27.974512 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-6d7c618a-c7f7-4a29-833e-42ea11842c30 req-c758405e-88c9-4391-8176-5428a6839c4f service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:27.975276 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-6d7c618a-c7f7-4a29-833e-42ea11842c30 req-c758405e-88c9-4391-8176-5428a6839c4f service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:27.995321 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-6d7c618a-c7f7-4a29-833e-42ea11842c30 req-c758405e-88c9-4391-8176-5428a6839c4f service nova] Creating event network-vif-deleted:2b8edb3c-5370-457e-be23-aab3a6c7d12d for instance 5bd544a7-a62e-434f-a842-e6231482d926 on hv-cinder-85221 Sep 01 16:37:28.005355 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-6d7c618a-c7f7-4a29-833e-42ea11842c30 req-c758405e-88c9-4391-8176-5428a6839c4f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048644 Sep 01 16:37:28.007367 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 102/196] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:37:28.825050 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f765e468-feb3-46e5-9161-4bb49b1e8dbd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:28.825758 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f765e468-feb3-46e5-9161-4bb49b1e8dbd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:28.844071 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f765e468-feb3-46e5-9161-4bb49b1e8dbd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:28.855565 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f765e468-feb3-46e5-9161-4bb49b1e8dbd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:28.856805 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f765e468-feb3-46e5-9161-4bb49b1e8dbd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:28.857555 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f765e468-feb3-46e5-9161-4bb49b1e8dbd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:28.858018 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f765e468-feb3-46e5-9161-4bb49b1e8dbd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:28.858438 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f765e468-feb3-46e5-9161-4bb49b1e8dbd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:28.936111 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0a26be8c-2ce7-4617-8f51-ba4e0d49b074 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:28.936927 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-0a26be8c-2ce7-4617-8f51-ba4e0d49b074 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] [instance: 5bd544a7-a62e-434f-a842-e6231482d926] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:28.945595 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0a26be8c-2ce7-4617-8f51-ba4e0d49b074 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:28.946563 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0a26be8c-2ce7-4617-8f51-ba4e0d49b074 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:28.947080 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0a26be8c-2ce7-4617-8f51-ba4e0d49b074 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:28.948190 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0a26be8c-2ce7-4617-8f51-ba4e0d49b074 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:28.948860 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0a26be8c-2ce7-4617-8f51-ba4e0d49b074 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:28.949481 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0a26be8c-2ce7-4617-8f51-ba4e0d49b074 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:29.019038 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0a26be8c-2ce7-4617-8f51-ba4e0d49b074 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:29.020323 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0a26be8c-2ce7-4617-8f51-ba4e0d49b074 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:29.020862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0a26be8c-2ce7-4617-8f51-ba4e0d49b074 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:29.021629 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.objects.instance [None req-0a26be8c-2ce7-4617-8f51-ba4e0d49b074 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lazy-loading 'fault' on Instance uuid 5bd544a7-a62e-434f-a842-e6231482d926 {{(pid=127199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:37:29.103782 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-0a26be8c-2ce7-4617-8f51-ba4e0d49b074 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b1fea950d48ef9a55cded8ed172a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130966aabcc04fc98c9f5139f826e78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:29.114818 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-0a26be8c-2ce7-4617-8f51-ba4e0d49b074 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] 10.222.0.62 "GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926" status: 200 len: 1350 microversion: 2.1 time: 0.190958 Sep 01 16:37:29.116656 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f765e468-feb3-46e5-9161-4bb49b1e8dbd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:29.120053 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 103/197] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:28 2022] GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926 => generated 1350 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:29.139523 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f765e468-feb3-46e5-9161-4bb49b1e8dbd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1522 microversion: 2.1 time: 0.318913 Sep 01 16:37:29.140893 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 95/198] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:28 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1522 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:30.145101 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-aae54f4a-2287-43d3-800e-8737a83f1d6e tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:30.146923 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-aae54f4a-2287-43d3-800e-8737a83f1d6e tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] [instance: 5bd544a7-a62e-434f-a842-e6231482d926] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:30.164651 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-44178739-9eee-4b83-8c2d-fc0ea40a0ed1 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:30.165233 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-44178739-9eee-4b83-8c2d-fc0ea40a0ed1 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:30.170236 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aae54f4a-2287-43d3-800e-8737a83f1d6e tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:30.170786 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aae54f4a-2287-43d3-800e-8737a83f1d6e tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:30.171229 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aae54f4a-2287-43d3-800e-8737a83f1d6e tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:30.172079 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aae54f4a-2287-43d3-800e-8737a83f1d6e tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:30.172409 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aae54f4a-2287-43d3-800e-8737a83f1d6e tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:30.172806 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aae54f4a-2287-43d3-800e-8737a83f1d6e tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:30.179463 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-44178739-9eee-4b83-8c2d-fc0ea40a0ed1 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:30.179953 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-44178739-9eee-4b83-8c2d-fc0ea40a0ed1 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:30.182510 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-44178739-9eee-4b83-8c2d-fc0ea40a0ed1 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:30.183495 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-44178739-9eee-4b83-8c2d-fc0ea40a0ed1 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:30.184675 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-44178739-9eee-4b83-8c2d-fc0ea40a0ed1 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:30.185301 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-44178739-9eee-4b83-8c2d-fc0ea40a0ed1 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:30.210569 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-aae54f4a-2287-43d3-800e-8737a83f1d6e tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] HTTP exception thrown: Instance 5bd544a7-a62e-434f-a842-e6231482d926 could not be found. Sep 01 16:37:30.215569 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-aae54f4a-2287-43d3-800e-8737a83f1d6e tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Request method failure captured: Sep 01 16:37:30.215569 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: request: GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926 HTTP/1.1 Sep 01 16:37:30.215569 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 01 16:37:30.215569 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 01 16:37:30.215569 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Connection: close Sep 01 16:37:30.215569 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 01 16:37:30.215569 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 01 16:37:30.215569 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Host: 10.222.0.62 Sep 01 16:37:30.215569 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 01 16:37:30.215569 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 01 16:37:30.215569 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjEN-NpaqiGacSvhpiWTf7EUbLz3tzEsgdwtJ_Ei13Bllq4CImbgfw8WCVbb3xmBgdcM2kkirX7eHOHcO2uaaG9sNqGViANj220gkTOJKpgZ2QZGv1Q31wsT3vGDQ0l5V7jXBcHkhMjIAd0aFQlX9tjemMIq08njoikcWwQ1J7BnQ177o Sep 01 16:37:30.215569 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 01 16:37:30.215569 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 01 16:37:30.215569 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 01 16:37:30.215569 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 01 16:37:30.215569 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 01 16:37:30.215569 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 01 16:37:30.215569 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Id: 130966aabcc04fc98c9f5139f826e78f Sep 01 16:37:30.215569 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-DeleteServersTestJSON-1942691224 Sep 01 16:37:30.215569 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 01 16:37:30.215569 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 01 16:37:30.217256 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/130966aabcc04fc98c9f5139f826e78f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/130966aabcc04fc98c9f5139f826e78f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_130966aabcc04fc98c9f5139f826e78f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/130966aabcc04fc98c9f5139f826e78f"}]}] Sep 01 16:37:30.217256 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-DeleteServersTestJSON-1942691224 Sep 01 16:37:30.217256 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Id: 130966aabcc04fc98c9f5139f826e78f Sep 01 16:37:30.217256 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-DeleteServersTestJSON-1942691224 Sep 01 16:37:30.217256 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User: tempest-DeleteServersTestJSON-1942691224-project Sep 01 16:37:30.217256 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 01 16:37:30.217256 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 01 16:37:30.217256 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Id: f21b1fea950d48ef9a55cded8ed172a6 Sep 01 16:37:30.217256 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-DeleteServersTestJSON-1942691224-project Sep 01 16:37:30.217256 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: method: > Sep 01 16:37:30.217256 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: exception: Instance 5bd544a7-a62e-434f-a842-e6231482d926 could not be found. Sep 01 16:37:30.217256 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: action_args: {'id': '5bd544a7-a62e-434f-a842-e6231482d926'} Sep 01 16:37:30.218084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:37:30.218084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:37:30.218084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:37:30.218084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:37:30.218084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:37:30.218084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:37:30.218084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:37:30.218084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:37:30.218084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:37:30.218084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:37:30.218084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bd544a7-a62e-434f-a842-e6231482d926 could not be found. Sep 01 16:37:30.218084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:37:30.218084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:37:30.218084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:37:30.218084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:37:30.218084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:37:30.218084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:37:30.218084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:37:30.218084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:37:30.218084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:37:30.219468 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:37:30.219468 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:37:30.219468 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:37:30.219468 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:37:30.219468 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:37:30.219468 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:37:30.219468 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:37:30.219468 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bd544a7-a62e-434f-a842-e6231482d926 could not be found. Sep 01 16:37:30.219468 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:37:30.219468 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:37:30.219468 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:37:30.219468 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:37:30.219468 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:37:30.219468 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:37:30.219468 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:37:30.219468 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:37:30.219468 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bd544a7-a62e-434f-a842-e6231482d926 could not be found. Sep 01 16:37:30.219468 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:37:30.231828 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-aae54f4a-2287-43d3-800e-8737a83f1d6e tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Returning 404 to user: Instance 5bd544a7-a62e-434f-a842-e6231482d926 could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:37:30.233254 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-aae54f4a-2287-43d3-800e-8737a83f1d6e tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] 10.222.0.62 "GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926" status: 404 len: 111 microversion: 2.1 time: 0.093642 Sep 01 16:37:30.233930 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 104/199] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:30 2022] GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:37:30.426050 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-44178739-9eee-4b83-8c2d-fc0ea40a0ed1 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:30.443599 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-44178739-9eee-4b83-8c2d-fc0ea40a0ed1 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1522 microversion: 2.1 time: 0.282950 Sep 01 16:37:30.445340 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 96/200] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:30 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:30.470452 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e620a5b5-e6d8-4bd0-a9d2-d6140ccfa913 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:30.473652 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e620a5b5-e6d8-4bd0-a9d2-d6140ccfa913 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] [instance: 5bd544a7-a62e-434f-a842-e6231482d926] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:30.481920 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e620a5b5-e6d8-4bd0-a9d2-d6140ccfa913 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:30.483029 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e620a5b5-e6d8-4bd0-a9d2-d6140ccfa913 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:30.483950 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e620a5b5-e6d8-4bd0-a9d2-d6140ccfa913 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:30.484677 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e620a5b5-e6d8-4bd0-a9d2-d6140ccfa913 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:30.485137 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e620a5b5-e6d8-4bd0-a9d2-d6140ccfa913 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:30.486092 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e620a5b5-e6d8-4bd0-a9d2-d6140ccfa913 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:30.510054 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-e620a5b5-e6d8-4bd0-a9d2-d6140ccfa913 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] HTTP exception thrown: Instance 5bd544a7-a62e-434f-a842-e6231482d926 could not be found. Sep 01 16:37:30.522434 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e620a5b5-e6d8-4bd0-a9d2-d6140ccfa913 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Request method failure captured: Sep 01 16:37:30.522434 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: request: GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926/os-volume_attachments HTTP/1.1 Sep 01 16:37:30.522434 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 01 16:37:30.522434 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 01 16:37:30.522434 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Connection: close Sep 01 16:37:30.522434 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 01 16:37:30.522434 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 01 16:37:30.522434 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Host: 10.222.0.62 Sep 01 16:37:30.522434 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 01 16:37:30.522434 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 01 16:37:30.522434 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjEN-NpaqiGacSvhpiWTf7EUbLz3tzEsgdwtJ_Ei13Bllq4CImbgfw8WCVbb3xmBgdcM2kkirX7eHOHcO2uaaG9sNqGViANj220gkTOJKpgZ2QZGv1Q31wsT3vGDQ0l5V7jXBcHkhMjIAd0aFQlX9tjemMIq08njoikcWwQ1J7BnQ177o Sep 01 16:37:30.522434 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 01 16:37:30.522434 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 01 16:37:30.522434 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 01 16:37:30.522434 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 01 16:37:30.522434 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 01 16:37:30.522434 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 01 16:37:30.522434 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Id: 130966aabcc04fc98c9f5139f826e78f Sep 01 16:37:30.522434 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-DeleteServersTestJSON-1942691224 Sep 01 16:37:30.522434 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 01 16:37:30.522434 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 01 16:37:30.523973 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/130966aabcc04fc98c9f5139f826e78f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/130966aabcc04fc98c9f5139f826e78f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_130966aabcc04fc98c9f5139f826e78f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/130966aabcc04fc98c9f5139f826e78f"}]}] Sep 01 16:37:30.523973 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-DeleteServersTestJSON-1942691224 Sep 01 16:37:30.523973 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Id: 130966aabcc04fc98c9f5139f826e78f Sep 01 16:37:30.523973 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-DeleteServersTestJSON-1942691224 Sep 01 16:37:30.523973 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User: tempest-DeleteServersTestJSON-1942691224-project Sep 01 16:37:30.523973 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 01 16:37:30.523973 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 01 16:37:30.523973 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Id: f21b1fea950d48ef9a55cded8ed172a6 Sep 01 16:37:30.523973 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-DeleteServersTestJSON-1942691224-project Sep 01 16:37:30.523973 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: method: > Sep 01 16:37:30.523973 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: exception: Instance 5bd544a7-a62e-434f-a842-e6231482d926 could not be found. Sep 01 16:37:30.523973 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: action_args: {'server_id': '5bd544a7-a62e-434f-a842-e6231482d926'} Sep 01 16:37:30.524714 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:37:30.524714 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:37:30.524714 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:37:30.524714 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:37:30.524714 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:37:30.524714 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:37:30.524714 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:37:30.524714 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:37:30.524714 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:37:30.524714 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:37:30.524714 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bd544a7-a62e-434f-a842-e6231482d926 could not be found. Sep 01 16:37:30.524714 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:37:30.524714 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:37:30.524714 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:37:30.524714 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:37:30.524714 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:37:30.524714 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:37:30.524714 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:37:30.524714 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:37:30.524714 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:37:30.526175 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:37:30.526175 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 16:37:30.526175 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 16:37:30.526175 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 16:37:30.526175 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 16:37:30.526175 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 01 16:37:30.526175 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 01 16:37:30.526175 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:37:30.526175 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:37:30.526175 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bd544a7-a62e-434f-a842-e6231482d926 could not be found. Sep 01 16:37:30.526175 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:37:30.526175 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:37:30.526175 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:37:30.526175 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:37:30.526175 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:37:30.526175 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:37:30.526175 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:37:30.526175 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:37:30.526175 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bd544a7-a62e-434f-a842-e6231482d926 could not be found. Sep 01 16:37:30.526175 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:37:30.532066 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e620a5b5-e6d8-4bd0-a9d2-d6140ccfa913 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Returning 404 to user: Instance 5bd544a7-a62e-434f-a842-e6231482d926 could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:37:30.533486 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e620a5b5-e6d8-4bd0-a9d2-d6140ccfa913 tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] 10.222.0.62 "GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.072616 Sep 01 16:37:30.534792 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 105/201] 10.222.0.62 () {58 vars in 1302 bytes} [Thu Sep 1 16:37:30 2022] GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926/os-volume_attachments => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:37:31.470661 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-210bbb56-0c72-46f6-8ca3-bf8d2a15801e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:31.472587 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-210bbb56-0c72-46f6-8ca3-bf8d2a15801e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:31.486844 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-210bbb56-0c72-46f6-8ca3-bf8d2a15801e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:31.487601 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-210bbb56-0c72-46f6-8ca3-bf8d2a15801e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:31.488065 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-210bbb56-0c72-46f6-8ca3-bf8d2a15801e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:31.489522 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-210bbb56-0c72-46f6-8ca3-bf8d2a15801e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:31.489991 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-210bbb56-0c72-46f6-8ca3-bf8d2a15801e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:31.490414 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-210bbb56-0c72-46f6-8ca3-bf8d2a15801e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:31.722357 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-210bbb56-0c72-46f6-8ca3-bf8d2a15801e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:31.735528 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-210bbb56-0c72-46f6-8ca3-bf8d2a15801e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1522 microversion: 2.1 time: 0.272533 Sep 01 16:37:31.737202 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 97/202] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:31 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:31.845025 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-90e5bfb1-1024-47eb-bfc8-da9d589b8b5d tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:31.845613 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-90e5bfb1-1024-47eb-bfc8-da9d589b8b5d tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] [instance: 5bd544a7-a62e-434f-a842-e6231482d926] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:31.860248 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-90e5bfb1-1024-47eb-bfc8-da9d589b8b5d tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:31.863673 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-90e5bfb1-1024-47eb-bfc8-da9d589b8b5d tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:31.864278 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-90e5bfb1-1024-47eb-bfc8-da9d589b8b5d tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:31.867798 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-90e5bfb1-1024-47eb-bfc8-da9d589b8b5d tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:31.868389 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-90e5bfb1-1024-47eb-bfc8-da9d589b8b5d tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:31.868942 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-90e5bfb1-1024-47eb-bfc8-da9d589b8b5d tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:31.938245 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-90e5bfb1-1024-47eb-bfc8-da9d589b8b5d tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] HTTP exception thrown: Instance 5bd544a7-a62e-434f-a842-e6231482d926 could not be found. Sep 01 16:37:31.941705 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-90e5bfb1-1024-47eb-bfc8-da9d589b8b5d tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Request method failure captured: Sep 01 16:37:31.941705 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: request: DELETE /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926 HTTP/1.1 Sep 01 16:37:31.941705 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 01 16:37:31.941705 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 01 16:37:31.941705 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Connection: close Sep 01 16:37:31.941705 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 01 16:37:31.941705 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 01 16:37:31.941705 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Host: 10.222.0.62 Sep 01 16:37:31.941705 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 01 16:37:31.941705 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 01 16:37:31.941705 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjEN-NpaqiGacSvhpiWTf7EUbLz3tzEsgdwtJ_Ei13Bllq4CImbgfw8WCVbb3xmBgdcM2kkirX7eHOHcO2uaaG9sNqGViANj220gkTOJKpgZ2QZGv1Q31wsT3vGDQ0l5V7jXBcHkhMjIAd0aFQlX9tjemMIq08njoikcWwQ1J7BnQ177o Sep 01 16:37:31.941705 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 01 16:37:31.941705 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 01 16:37:31.941705 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 01 16:37:31.941705 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 01 16:37:31.941705 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 01 16:37:31.941705 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 01 16:37:31.941705 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Id: 130966aabcc04fc98c9f5139f826e78f Sep 01 16:37:31.941705 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-DeleteServersTestJSON-1942691224 Sep 01 16:37:31.941705 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 01 16:37:31.941705 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 01 16:37:31.943819 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/130966aabcc04fc98c9f5139f826e78f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/130966aabcc04fc98c9f5139f826e78f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_130966aabcc04fc98c9f5139f826e78f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/130966aabcc04fc98c9f5139f826e78f"}]}] Sep 01 16:37:31.943819 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-DeleteServersTestJSON-1942691224 Sep 01 16:37:31.943819 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Id: 130966aabcc04fc98c9f5139f826e78f Sep 01 16:37:31.943819 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-DeleteServersTestJSON-1942691224 Sep 01 16:37:31.943819 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User: tempest-DeleteServersTestJSON-1942691224-project Sep 01 16:37:31.943819 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 01 16:37:31.943819 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 01 16:37:31.943819 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Id: f21b1fea950d48ef9a55cded8ed172a6 Sep 01 16:37:31.943819 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-DeleteServersTestJSON-1942691224-project Sep 01 16:37:31.943819 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: method: > Sep 01 16:37:31.943819 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: exception: Instance 5bd544a7-a62e-434f-a842-e6231482d926 could not be found. Sep 01 16:37:31.943819 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: action_args: {'id': '5bd544a7-a62e-434f-a842-e6231482d926'} Sep 01 16:37:31.944738 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:37:31.944738 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:37:31.944738 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:37:31.944738 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:37:31.944738 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:37:31.944738 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:37:31.944738 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:37:31.944738 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:37:31.944738 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:37:31.944738 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:37:31.944738 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bd544a7-a62e-434f-a842-e6231482d926 could not be found. Sep 01 16:37:31.944738 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:37:31.944738 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:37:31.944738 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:37:31.944738 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:37:31.944738 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:37:31.944738 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:37:31.944738 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:37:31.944738 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:37:31.944738 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:37:31.946024 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:37:31.946024 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 16:37:31.946024 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 16:37:31.946024 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 16:37:31.946024 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 16:37:31.946024 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:37:31.946024 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:37:31.946024 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:37:31.946024 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:37:31.946024 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bd544a7-a62e-434f-a842-e6231482d926 could not be found. Sep 01 16:37:31.946024 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:37:31.946024 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:37:31.946024 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:37:31.946024 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:37:31.946024 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:37:31.946024 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:37:31.946024 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:37:31.946024 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:37:31.946024 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bd544a7-a62e-434f-a842-e6231482d926 could not be found. Sep 01 16:37:31.946024 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:37:31.955119 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-90e5bfb1-1024-47eb-bfc8-da9d589b8b5d tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Returning 404 to user: Instance 5bd544a7-a62e-434f-a842-e6231482d926 could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:37:31.956439 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-90e5bfb1-1024-47eb-bfc8-da9d589b8b5d tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] 10.222.0.62 "DELETE /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926" status: 404 len: 111 microversion: 2.1 time: 0.120139 Sep 01 16:37:31.957513 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 106/203] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Sep 1 16:37:31 2022] DELETE /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:37:32.035766 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8ea154d4-df1e-4906-abfd-fbefbc66f4fe tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:32.036966 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8ea154d4-df1e-4906-abfd-fbefbc66f4fe tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] [instance: 5bd544a7-a62e-434f-a842-e6231482d926] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:32.047673 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8ea154d4-df1e-4906-abfd-fbefbc66f4fe tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:32.048893 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8ea154d4-df1e-4906-abfd-fbefbc66f4fe tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:32.050016 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8ea154d4-df1e-4906-abfd-fbefbc66f4fe tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:32.051364 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8ea154d4-df1e-4906-abfd-fbefbc66f4fe tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:32.052636 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8ea154d4-df1e-4906-abfd-fbefbc66f4fe tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:32.053435 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8ea154d4-df1e-4906-abfd-fbefbc66f4fe tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:32.082008 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-8ea154d4-df1e-4906-abfd-fbefbc66f4fe tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] HTTP exception thrown: Instance 5bd544a7-a62e-434f-a842-e6231482d926 could not be found. Sep 01 16:37:32.096399 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8ea154d4-df1e-4906-abfd-fbefbc66f4fe tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Request method failure captured: Sep 01 16:37:32.096399 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926 HTTP/1.1 Sep 01 16:37:32.096399 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 01 16:37:32.096399 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 01 16:37:32.096399 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Connection: close Sep 01 16:37:32.096399 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 01 16:37:32.096399 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 01 16:37:32.096399 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Host: 10.222.0.62 Sep 01 16:37:32.096399 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 01 16:37:32.096399 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 01 16:37:32.096399 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjEN-NpaqiGacSvhpiWTf7EUbLz3tzEsgdwtJ_Ei13Bllq4CImbgfw8WCVbb3xmBgdcM2kkirX7eHOHcO2uaaG9sNqGViANj220gkTOJKpgZ2QZGv1Q31wsT3vGDQ0l5V7jXBcHkhMjIAd0aFQlX9tjemMIq08njoikcWwQ1J7BnQ177o Sep 01 16:37:32.096399 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 01 16:37:32.096399 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 01 16:37:32.096399 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 01 16:37:32.096399 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 01 16:37:32.096399 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 01 16:37:32.096399 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 01 16:37:32.096399 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Id: 130966aabcc04fc98c9f5139f826e78f Sep 01 16:37:32.096399 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-DeleteServersTestJSON-1942691224 Sep 01 16:37:32.096399 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 01 16:37:32.096399 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 01 16:37:32.098969 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/130966aabcc04fc98c9f5139f826e78f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/130966aabcc04fc98c9f5139f826e78f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_130966aabcc04fc98c9f5139f826e78f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/130966aabcc04fc98c9f5139f826e78f"}]}] Sep 01 16:37:32.098969 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-DeleteServersTestJSON-1942691224 Sep 01 16:37:32.098969 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Id: 130966aabcc04fc98c9f5139f826e78f Sep 01 16:37:32.098969 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-DeleteServersTestJSON-1942691224 Sep 01 16:37:32.098969 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User: tempest-DeleteServersTestJSON-1942691224-project Sep 01 16:37:32.098969 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 01 16:37:32.098969 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 01 16:37:32.098969 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Id: f21b1fea950d48ef9a55cded8ed172a6 Sep 01 16:37:32.098969 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-DeleteServersTestJSON-1942691224-project Sep 01 16:37:32.098969 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: method: > Sep 01 16:37:32.098969 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: exception: Instance 5bd544a7-a62e-434f-a842-e6231482d926 could not be found. Sep 01 16:37:32.098969 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: action_args: {'id': '5bd544a7-a62e-434f-a842-e6231482d926'} Sep 01 16:37:32.100441 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:37:32.100441 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:37:32.100441 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:37:32.100441 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:37:32.100441 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:37:32.100441 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:37:32.100441 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:37:32.100441 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:37:32.100441 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:37:32.100441 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:37:32.100441 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bd544a7-a62e-434f-a842-e6231482d926 could not be found. Sep 01 16:37:32.100441 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:37:32.100441 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:37:32.100441 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:37:32.100441 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:37:32.100441 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:37:32.100441 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:37:32.100441 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:37:32.100441 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:37:32.100441 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:37:32.102809 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:37:32.102809 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:37:32.102809 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:37:32.102809 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:37:32.102809 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:37:32.102809 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:37:32.102809 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:37:32.102809 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bd544a7-a62e-434f-a842-e6231482d926 could not be found. Sep 01 16:37:32.102809 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:37:32.102809 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:37:32.102809 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:37:32.102809 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:37:32.102809 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:37:32.102809 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:37:32.102809 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:37:32.102809 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:37:32.102809 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bd544a7-a62e-434f-a842-e6231482d926 could not be found. Sep 01 16:37:32.102809 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:37:32.105242 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8ea154d4-df1e-4906-abfd-fbefbc66f4fe tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] Returning 404 to user: Instance 5bd544a7-a62e-434f-a842-e6231482d926 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:37:32.105242 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8ea154d4-df1e-4906-abfd-fbefbc66f4fe tempest-DeleteServersTestJSON-1942691224 tempest-DeleteServersTestJSON-1942691224-project] 10.222.0.62 "GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926" status: 404 len: 111 microversion: 2.1 time: 0.113393 Sep 01 16:37:32.107135 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 98/204] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:31 2022] GET /compute/v2.1/servers/5bd544a7-a62e-434f-a842-e6231482d926 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:37:32.774792 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-675c3282-b5c2-4938-bcb6-35951e44efd0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:32.775416 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-675c3282-b5c2-4938-bcb6-35951e44efd0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:32.790733 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-675c3282-b5c2-4938-bcb6-35951e44efd0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:32.792239 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-675c3282-b5c2-4938-bcb6-35951e44efd0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:32.794347 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-675c3282-b5c2-4938-bcb6-35951e44efd0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:32.795267 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-675c3282-b5c2-4938-bcb6-35951e44efd0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:32.798298 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-675c3282-b5c2-4938-bcb6-35951e44efd0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:32.798954 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-675c3282-b5c2-4938-bcb6-35951e44efd0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:33.593074 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-675c3282-b5c2-4938-bcb6-35951e44efd0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:33.602925 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-675c3282-b5c2-4938-bcb6-35951e44efd0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1522 microversion: 2.1 time: 0.832021 Sep 01 16:37:33.603720 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 107/205] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:32 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1522 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:37:34.628430 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-045b64a4-891b-47f2-89d3-5a1aaab91608 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:34.632414 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-045b64a4-891b-47f2-89d3-5a1aaab91608 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:34.649608 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-045b64a4-891b-47f2-89d3-5a1aaab91608 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:34.650662 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-045b64a4-891b-47f2-89d3-5a1aaab91608 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:34.651320 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-045b64a4-891b-47f2-89d3-5a1aaab91608 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:34.655118 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-045b64a4-891b-47f2-89d3-5a1aaab91608 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:34.655999 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-045b64a4-891b-47f2-89d3-5a1aaab91608 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:34.656663 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-045b64a4-891b-47f2-89d3-5a1aaab91608 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:34.982578 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f6c59343-aa61-4d3c-b333-ce7eb67617e2 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Action: 'create', calling method: .version_select at 0x7f9482564f70>, body: {"keypair": {"name": "tempest-TestShelveInstance-16309676", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJaqsCpaqXSQKpI+aM+CYNFqo3d1XgcZ9KD8YICSwr+mdPWKPsSJWgt1UccTIHaAr+IPG2XO5/YlcpazEkLJTZjod2HqJg7dv8VzOm/+vqcsxzOSIdAMRS+xsTCiBeftw=="}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:35.021460 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-f6c59343-aa61-4d3c-b333-ce7eb67617e2 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Getting quotas for project d5df463e3a1640ec8041d2b4bb6311f2. Resources: {'key_pairs'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:37:35.027396 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-f6c59343-aa61-4d3c-b333-ce7eb67617e2 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Getting quotas for user da359f520a9d411eb52da5700c07f8d7 and project d5df463e3a1640ec8041d2b4bb6311f2. Resources: {'key_pairs'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:37:35.093829 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f6c59343-aa61-4d3c-b333-ce7eb67617e2 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.583875 Sep 01 16:37:35.094686 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 99/206] 10.222.0.62 () {60 vars in 1159 bytes} [Thu Sep 1 16:37:34 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:37:35.188077 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-045b64a4-891b-47f2-89d3-5a1aaab91608 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:35.200553 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-045b64a4-891b-47f2-89d3-5a1aaab91608 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1522 microversion: 2.1 time: 0.574082 Sep 01 16:37:35.215827 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 108/207] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:34 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1522 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:36.228864 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5b7dcc84-f32a-47aa-bea4-ac80e0795322 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:36.229963 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5b7dcc84-f32a-47aa-bea4-ac80e0795322 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:36.266011 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5b7dcc84-f32a-47aa-bea4-ac80e0795322 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:36.266555 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5b7dcc84-f32a-47aa-bea4-ac80e0795322 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:36.267241 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5b7dcc84-f32a-47aa-bea4-ac80e0795322 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:36.268133 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5b7dcc84-f32a-47aa-bea4-ac80e0795322 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:36.268630 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5b7dcc84-f32a-47aa-bea4-ac80e0795322 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:36.269059 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5b7dcc84-f32a-47aa-bea4-ac80e0795322 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:36.771584 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5b7dcc84-f32a-47aa-bea4-ac80e0795322 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:36.783065 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5b7dcc84-f32a-47aa-bea4-ac80e0795322 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1522 microversion: 2.1 time: 0.563494 Sep 01 16:37:36.785582 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 100/208] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:36 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1522 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:37.808064 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ddada77e-c08a-4ae8-ab62-a4f5cdcf6432 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:37.808689 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ddada77e-c08a-4ae8-ab62-a4f5cdcf6432 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:37.828697 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ddada77e-c08a-4ae8-ab62-a4f5cdcf6432 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:37.829336 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ddada77e-c08a-4ae8-ab62-a4f5cdcf6432 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:37.829894 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ddada77e-c08a-4ae8-ab62-a4f5cdcf6432 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:37.830756 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ddada77e-c08a-4ae8-ab62-a4f5cdcf6432 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:37.831290 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ddada77e-c08a-4ae8-ab62-a4f5cdcf6432 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:37.831855 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ddada77e-c08a-4ae8-ab62-a4f5cdcf6432 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:38.566837 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ddada77e-c08a-4ae8-ab62-a4f5cdcf6432 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:38.581250 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ddada77e-c08a-4ae8-ab62-a4f5cdcf6432 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1522 microversion: 2.1 time: 0.779073 Sep 01 16:37:38.587995 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 109/209] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:37 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1522 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:37:39.605494 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ecdaf6b2-f735-4c95-97a5-040941d551b8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:39.606844 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ecdaf6b2-f735-4c95-97a5-040941d551b8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:39.614757 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ecdaf6b2-f735-4c95-97a5-040941d551b8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:39.615724 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ecdaf6b2-f735-4c95-97a5-040941d551b8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:39.616595 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ecdaf6b2-f735-4c95-97a5-040941d551b8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:39.617778 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ecdaf6b2-f735-4c95-97a5-040941d551b8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:39.618590 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ecdaf6b2-f735-4c95-97a5-040941d551b8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:39.619423 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ecdaf6b2-f735-4c95-97a5-040941d551b8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:39.780319 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ecdaf6b2-f735-4c95-97a5-040941d551b8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:39.797917 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ecdaf6b2-f735-4c95-97a5-040941d551b8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1522 microversion: 2.1 time: 0.196189 Sep 01 16:37:39.798953 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 101/210] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:39 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:40.820067 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-2135be85-d168-4f01-9219-7720a6012609 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:40.820750 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-2135be85-d168-4f01-9219-7720a6012609 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:40.823570 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=48 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:40.829836 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2135be85-d168-4f01-9219-7720a6012609 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:40.830327 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2135be85-d168-4f01-9219-7720a6012609 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:40.830754 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2135be85-d168-4f01-9219-7720a6012609 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:40.831578 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2135be85-d168-4f01-9219-7720a6012609 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:40.832061 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2135be85-d168-4f01-9219-7720a6012609 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:40.832484 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2135be85-d168-4f01-9219-7720a6012609 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:40.998943 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-2135be85-d168-4f01-9219-7720a6012609 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:41.007837 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-2135be85-d168-4f01-9219-7720a6012609 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1522 microversion: 2.1 time: 0.191667 Sep 01 16:37:41.008711 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 110/211] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:40 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:42.031242 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-082a58eb-32f6-41ee-b4da-745c40a396e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:42.032382 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-082a58eb-32f6-41ee-b4da-745c40a396e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:42.040231 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-082a58eb-32f6-41ee-b4da-745c40a396e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:42.040783 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-082a58eb-32f6-41ee-b4da-745c40a396e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:42.041438 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-082a58eb-32f6-41ee-b4da-745c40a396e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:42.042263 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-082a58eb-32f6-41ee-b4da-745c40a396e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:42.042750 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-082a58eb-32f6-41ee-b4da-745c40a396e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:42.043227 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-082a58eb-32f6-41ee-b4da-745c40a396e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:42.202741 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-082a58eb-32f6-41ee-b4da-745c40a396e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:42.210971 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-082a58eb-32f6-41ee-b4da-745c40a396e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1522 microversion: 2.1 time: 0.184921 Sep 01 16:37:42.211564 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 102/212] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:42 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:43.234677 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-36eeeb47-90dd-4c0a-a8dc-f0e57cada822 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:43.235256 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-36eeeb47-90dd-4c0a-a8dc-f0e57cada822 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:43.242351 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-36eeeb47-90dd-4c0a-a8dc-f0e57cada822 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:43.242968 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-36eeeb47-90dd-4c0a-a8dc-f0e57cada822 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:43.243498 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-36eeeb47-90dd-4c0a-a8dc-f0e57cada822 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:43.244476 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-36eeeb47-90dd-4c0a-a8dc-f0e57cada822 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:43.245109 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-36eeeb47-90dd-4c0a-a8dc-f0e57cada822 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:43.245691 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-36eeeb47-90dd-4c0a-a8dc-f0e57cada822 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:43.404322 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-36eeeb47-90dd-4c0a-a8dc-f0e57cada822 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:43.414620 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-36eeeb47-90dd-4c0a-a8dc-f0e57cada822 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1522 microversion: 2.1 time: 0.186122 Sep 01 16:37:43.415236 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 111/213] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:43 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:44.443148 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ea0268e6-9016-40dc-9201-06361ed80cd0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:44.444072 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ea0268e6-9016-40dc-9201-06361ed80cd0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:44.448216 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:44.457836 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ea0268e6-9016-40dc-9201-06361ed80cd0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:44.458624 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ea0268e6-9016-40dc-9201-06361ed80cd0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:44.459339 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ea0268e6-9016-40dc-9201-06361ed80cd0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:44.460497 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ea0268e6-9016-40dc-9201-06361ed80cd0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:44.461265 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ea0268e6-9016-40dc-9201-06361ed80cd0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:44.461954 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ea0268e6-9016-40dc-9201-06361ed80cd0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:44.640431 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ea0268e6-9016-40dc-9201-06361ed80cd0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:44.648481 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ea0268e6-9016-40dc-9201-06361ed80cd0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1522 microversion: 2.1 time: 0.212190 Sep 01 16:37:44.649060 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 103/214] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:44 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:45.671413 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-43d2f167-393f-4be9-a1d2-514b7aca0d7a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:45.672243 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-43d2f167-393f-4be9-a1d2-514b7aca0d7a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:45.678506 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-43d2f167-393f-4be9-a1d2-514b7aca0d7a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:45.678996 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-43d2f167-393f-4be9-a1d2-514b7aca0d7a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:45.679419 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-43d2f167-393f-4be9-a1d2-514b7aca0d7a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:45.680140 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-43d2f167-393f-4be9-a1d2-514b7aca0d7a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:45.680587 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-43d2f167-393f-4be9-a1d2-514b7aca0d7a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:45.681001 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-43d2f167-393f-4be9-a1d2-514b7aca0d7a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:45.864320 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-43d2f167-393f-4be9-a1d2-514b7aca0d7a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:45.871330 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-43d2f167-393f-4be9-a1d2-514b7aca0d7a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1522 microversion: 2.1 time: 0.203460 Sep 01 16:37:45.872900 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 112/215] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:45 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:46.895053 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-88615cd0-26f1-458b-a218-1260b0007078 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:46.896498 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-88615cd0-26f1-458b-a218-1260b0007078 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:46.899855 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=4 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:46.905704 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-88615cd0-26f1-458b-a218-1260b0007078 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:46.906296 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-88615cd0-26f1-458b-a218-1260b0007078 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:46.906794 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-88615cd0-26f1-458b-a218-1260b0007078 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:46.907555 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-88615cd0-26f1-458b-a218-1260b0007078 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:46.908122 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-88615cd0-26f1-458b-a218-1260b0007078 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:46.908741 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-88615cd0-26f1-458b-a218-1260b0007078 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:47.056001 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-88615cd0-26f1-458b-a218-1260b0007078 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:47.068653 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-88615cd0-26f1-458b-a218-1260b0007078 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1522 microversion: 2.1 time: 0.174359 Sep 01 16:37:47.068653 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 104/216] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:46 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:48.089094 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c7fdeec5-f0ca-4df7-96da-b08aef81f9d4 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:48.089884 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-c7fdeec5-f0ca-4df7-96da-b08aef81f9d4 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:48.096314 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c7fdeec5-f0ca-4df7-96da-b08aef81f9d4 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:48.096780 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c7fdeec5-f0ca-4df7-96da-b08aef81f9d4 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:48.097213 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c7fdeec5-f0ca-4df7-96da-b08aef81f9d4 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:48.097971 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c7fdeec5-f0ca-4df7-96da-b08aef81f9d4 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:48.098454 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c7fdeec5-f0ca-4df7-96da-b08aef81f9d4 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:48.098859 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c7fdeec5-f0ca-4df7-96da-b08aef81f9d4 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:48.268449 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c7fdeec5-f0ca-4df7-96da-b08aef81f9d4 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:48.288314 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-c7fdeec5-f0ca-4df7-96da-b08aef81f9d4 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1522 microversion: 2.1 time: 0.195166 Sep 01 16:37:48.288314 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 113/217] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:48 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:37:49.302711 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5a7ebfa2-2d93-4977-9957-16f89b139fa3 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:49.303261 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5a7ebfa2-2d93-4977-9957-16f89b139fa3 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:49.310323 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5a7ebfa2-2d93-4977-9957-16f89b139fa3 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:49.310805 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5a7ebfa2-2d93-4977-9957-16f89b139fa3 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:49.311240 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5a7ebfa2-2d93-4977-9957-16f89b139fa3 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:49.311931 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5a7ebfa2-2d93-4977-9957-16f89b139fa3 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:49.312408 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5a7ebfa2-2d93-4977-9957-16f89b139fa3 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:49.312855 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5a7ebfa2-2d93-4977-9957-16f89b139fa3 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:49.453760 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5a7ebfa2-2d93-4977-9957-16f89b139fa3 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:49.461774 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5a7ebfa2-2d93-4977-9957-16f89b139fa3 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1522 microversion: 2.1 time: 0.162975 Sep 01 16:37:49.462340 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 105/218] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:49 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:50.483152 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-826545a6-1419-49ed-ba0e-bd9b6b36b599 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:50.483756 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-826545a6-1419-49ed-ba0e-bd9b6b36b599 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:50.490827 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-826545a6-1419-49ed-ba0e-bd9b6b36b599 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:50.491335 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-826545a6-1419-49ed-ba0e-bd9b6b36b599 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:50.491796 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-826545a6-1419-49ed-ba0e-bd9b6b36b599 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:50.492533 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-826545a6-1419-49ed-ba0e-bd9b6b36b599 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:50.492978 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-826545a6-1419-49ed-ba0e-bd9b6b36b599 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:50.493389 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-826545a6-1419-49ed-ba0e-bd9b6b36b599 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:50.644011 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-826545a6-1419-49ed-ba0e-bd9b6b36b599 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:50.652316 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-826545a6-1419-49ed-ba0e-bd9b6b36b599 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1522 microversion: 2.1 time: 0.173230 Sep 01 16:37:50.652861 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 114/219] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:50 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:51.674140 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ddf89959-5a66-406e-ac63-89ae13c8ac89 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:51.674730 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ddf89959-5a66-406e-ac63-89ae13c8ac89 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:51.681489 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ddf89959-5a66-406e-ac63-89ae13c8ac89 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:51.681974 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ddf89959-5a66-406e-ac63-89ae13c8ac89 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:51.682405 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ddf89959-5a66-406e-ac63-89ae13c8ac89 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:51.683240 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ddf89959-5a66-406e-ac63-89ae13c8ac89 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:51.683705 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ddf89959-5a66-406e-ac63-89ae13c8ac89 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:51.684162 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ddf89959-5a66-406e-ac63-89ae13c8ac89 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:51.829661 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ddf89959-5a66-406e-ac63-89ae13c8ac89 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:51.837782 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ddf89959-5a66-406e-ac63-89ae13c8ac89 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1522 microversion: 2.1 time: 0.167700 Sep 01 16:37:51.838700 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 106/220] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:51 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:52.859632 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-f9b67746-80b0-459b-9f4a-43428826248d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:52.860330 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-f9b67746-80b0-459b-9f4a-43428826248d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:52.867832 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f9b67746-80b0-459b-9f4a-43428826248d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:52.868569 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f9b67746-80b0-459b-9f4a-43428826248d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:52.874229 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f9b67746-80b0-459b-9f4a-43428826248d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:52.874229 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f9b67746-80b0-459b-9f4a-43428826248d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:52.874229 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f9b67746-80b0-459b-9f4a-43428826248d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:52.874229 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f9b67746-80b0-459b-9f4a-43428826248d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:53.062162 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-f9b67746-80b0-459b-9f4a-43428826248d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:53.064599 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=91 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:53.072603 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-f9b67746-80b0-459b-9f4a-43428826248d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1522 microversion: 2.1 time: 0.217416 Sep 01 16:37:53.073238 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 115/221] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:52 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:54.095157 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1fc4254f-c071-4a25-8752-9b7eb3962a2b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:54.095747 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1fc4254f-c071-4a25-8752-9b7eb3962a2b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:54.102647 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1fc4254f-c071-4a25-8752-9b7eb3962a2b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:54.103135 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1fc4254f-c071-4a25-8752-9b7eb3962a2b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:54.103569 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1fc4254f-c071-4a25-8752-9b7eb3962a2b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:54.104293 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1fc4254f-c071-4a25-8752-9b7eb3962a2b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:54.104747 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1fc4254f-c071-4a25-8752-9b7eb3962a2b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:54.105169 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1fc4254f-c071-4a25-8752-9b7eb3962a2b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:54.285103 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1fc4254f-c071-4a25-8752-9b7eb3962a2b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:54.288943 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:54.298310 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1fc4254f-c071-4a25-8752-9b7eb3962a2b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1522 microversion: 2.1 time: 0.206912 Sep 01 16:37:54.299207 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 107/222] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:54 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:55.332886 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-db838460-be6b-4a1c-b056-b1e109ae5018 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:55.333640 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-db838460-be6b-4a1c-b056-b1e109ae5018 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:55.340093 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-db838460-be6b-4a1c-b056-b1e109ae5018 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:55.340595 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-db838460-be6b-4a1c-b056-b1e109ae5018 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:55.341018 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-db838460-be6b-4a1c-b056-b1e109ae5018 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:55.341711 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-db838460-be6b-4a1c-b056-b1e109ae5018 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:55.342440 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-db838460-be6b-4a1c-b056-b1e109ae5018 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:55.342912 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-db838460-be6b-4a1c-b056-b1e109ae5018 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:55.540369 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-db838460-be6b-4a1c-b056-b1e109ae5018 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:55.549062 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-db838460-be6b-4a1c-b056-b1e109ae5018 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1522 microversion: 2.1 time: 0.223483 Sep 01 16:37:55.549647 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 116/223] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:55 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:56.570763 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3c3b0a29-b88f-4fbb-b3c3-d693a396689e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:56.571373 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-3c3b0a29-b88f-4fbb-b3c3-d693a396689e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:56.579442 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3c3b0a29-b88f-4fbb-b3c3-d693a396689e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:56.579942 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3c3b0a29-b88f-4fbb-b3c3-d693a396689e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:56.580380 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3c3b0a29-b88f-4fbb-b3c3-d693a396689e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:56.581077 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3c3b0a29-b88f-4fbb-b3c3-d693a396689e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:56.581616 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3c3b0a29-b88f-4fbb-b3c3-d693a396689e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:56.582039 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3c3b0a29-b88f-4fbb-b3c3-d693a396689e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:56.782127 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3c3b0a29-b88f-4fbb-b3c3-d693a396689e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:56.793275 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3c3b0a29-b88f-4fbb-b3c3-d693a396689e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1522 microversion: 2.1 time: 0.226364 Sep 01 16:37:56.794220 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 108/224] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:56 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:57.816654 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-1b63a90e-79b0-4765-987b-71b2a0858677 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:57.817266 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-1b63a90e-79b0-4765-987b-71b2a0858677 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:57.824231 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1b63a90e-79b0-4765-987b-71b2a0858677 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:57.824724 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1b63a90e-79b0-4765-987b-71b2a0858677 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:57.825157 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1b63a90e-79b0-4765-987b-71b2a0858677 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:57.825872 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1b63a90e-79b0-4765-987b-71b2a0858677 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:57.826314 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1b63a90e-79b0-4765-987b-71b2a0858677 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:57.826760 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1b63a90e-79b0-4765-987b-71b2a0858677 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:57.988769 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-1b63a90e-79b0-4765-987b-71b2a0858677 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:57.997120 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-1b63a90e-79b0-4765-987b-71b2a0858677 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1522 microversion: 2.1 time: 0.184429 Sep 01 16:37:57.997695 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 117/225] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:57 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:59.023220 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-bad61516-7ba6-4319-8614-fb9c8f205df3 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:59.025145 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-bad61516-7ba6-4319-8614-fb9c8f205df3 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:59.033745 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bad61516-7ba6-4319-8614-fb9c8f205df3 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:59.034709 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bad61516-7ba6-4319-8614-fb9c8f205df3 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:59.034839 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bad61516-7ba6-4319-8614-fb9c8f205df3 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:59.035522 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bad61516-7ba6-4319-8614-fb9c8f205df3 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:59.036247 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bad61516-7ba6-4319-8614-fb9c8f205df3 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:59.036684 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bad61516-7ba6-4319-8614-fb9c8f205df3 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:59.191413 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-bad61516-7ba6-4319-8614-fb9c8f205df3 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:59.199709 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-bad61516-7ba6-4319-8614-fb9c8f205df3 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1502 microversion: 2.1 time: 0.182698 Sep 01 16:37:59.200344 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 109/226] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:59 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1502 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:59.225253 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-af01e6a4-3952-4334-913e-766de44f858d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:59.226277 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-af01e6a4-3952-4334-913e-766de44f858d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:59.233394 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-af01e6a4-3952-4334-913e-766de44f858d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:59.234043 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-af01e6a4-3952-4334-913e-766de44f858d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:59.234348 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-af01e6a4-3952-4334-913e-766de44f858d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:59.235163 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-af01e6a4-3952-4334-913e-766de44f858d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:59.235594 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-af01e6a4-3952-4334-913e-766de44f858d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:59.236041 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-af01e6a4-3952-4334-913e-766de44f858d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:59.402360 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-af01e6a4-3952-4334-913e-766de44f858d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:59.414085 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-af01e6a4-3952-4334-913e-766de44f858d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648" status: 200 len: 1516 microversion: 2.1 time: 0.193345 Sep 01 16:37:59.417497 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 118/227] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:59 2022] GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648 => generated 1516 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:00.965569 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-476ede97-dfad-4d69-8d8d-edd997a3c7bd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:00.968151 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-476ede97-dfad-4d69-8d8d-edd997a3c7bd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:00.975041 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-476ede97-dfad-4d69-8d8d-edd997a3c7bd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:00.975690 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-476ede97-dfad-4d69-8d8d-edd997a3c7bd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:00.976390 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-476ede97-dfad-4d69-8d8d-edd997a3c7bd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:00.977207 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-476ede97-dfad-4d69-8d8d-edd997a3c7bd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:00.978068 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-476ede97-dfad-4d69-8d8d-edd997a3c7bd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:00.978521 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-476ede97-dfad-4d69-8d8d-edd997a3c7bd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:01.012540 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-476ede97-dfad-4d69-8d8d-edd997a3c7bd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lazy-loading 'flavor' on Instance uuid 5537b019-c314-4b22-bde4-b19b3641c648 {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:38:01.154959 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-476ede97-dfad-4d69-8d8d-edd997a3c7bd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "POST /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648/action" status: 200 len: 32 microversion: 2.1 time: 0.194611 Sep 01 16:38:01.156236 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 110/228] 10.222.0.62 () {60 vars in 1278 bytes} [Thu Sep 1 16:38:00 2022] POST /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648/action => generated 32 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 16:38:01.165711 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-058192af-6921-4064-b5d3-1524cd65bdee tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:01.166969 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-058192af-6921-4064-b5d3-1524cd65bdee tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:01.184166 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-058192af-6921-4064-b5d3-1524cd65bdee tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:01.184947 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-058192af-6921-4064-b5d3-1524cd65bdee tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:01.185559 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-058192af-6921-4064-b5d3-1524cd65bdee tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:01.186689 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-058192af-6921-4064-b5d3-1524cd65bdee tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:01.187386 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-058192af-6921-4064-b5d3-1524cd65bdee tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:01.187787 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-058192af-6921-4064-b5d3-1524cd65bdee tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:01.442553 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-058192af-6921-4064-b5d3-1524cd65bdee tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:01.451547 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-058192af-6921-4064-b5d3-1524cd65bdee tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648" status: 200 len: 1522 microversion: 2.1 time: 0.289945 Sep 01 16:38:01.452136 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 119/229] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:01 2022] GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:02.477570 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2380312d-68db-46da-903b-4560d4bc7a3c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:02.479703 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-2380312d-68db-46da-903b-4560d4bc7a3c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:02.490604 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2380312d-68db-46da-903b-4560d4bc7a3c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:02.491189 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2380312d-68db-46da-903b-4560d4bc7a3c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:02.491971 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2380312d-68db-46da-903b-4560d4bc7a3c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:02.493119 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2380312d-68db-46da-903b-4560d4bc7a3c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:02.493762 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2380312d-68db-46da-903b-4560d4bc7a3c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:02.494430 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2380312d-68db-46da-903b-4560d4bc7a3c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:02.749792 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2380312d-68db-46da-903b-4560d4bc7a3c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:02.762391 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2380312d-68db-46da-903b-4560d4bc7a3c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648" status: 200 len: 1522 microversion: 2.1 time: 0.292296 Sep 01 16:38:02.763188 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 111/230] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:02 2022] GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648 => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:03.787143 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ed66110b-5e58-4e99-a60b-d4c99095fc61 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:03.787754 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ed66110b-5e58-4e99-a60b-d4c99095fc61 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:03.796078 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ed66110b-5e58-4e99-a60b-d4c99095fc61 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:03.796566 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ed66110b-5e58-4e99-a60b-d4c99095fc61 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:03.797005 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ed66110b-5e58-4e99-a60b-d4c99095fc61 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:03.797700 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ed66110b-5e58-4e99-a60b-d4c99095fc61 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:03.798141 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ed66110b-5e58-4e99-a60b-d4c99095fc61 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:03.798557 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ed66110b-5e58-4e99-a60b-d4c99095fc61 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:03.949464 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ed66110b-5e58-4e99-a60b-d4c99095fc61 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:03.959787 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ed66110b-5e58-4e99-a60b-d4c99095fc61 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648" status: 200 len: 1522 microversion: 2.1 time: 0.177389 Sep 01 16:38:03.968315 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 120/231] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:03 2022] GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:04.980227 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-cc13b474-636a-4642-a3fc-172a46f2f685 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:04.981153 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-cc13b474-636a-4642-a3fc-172a46f2f685 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:04.987654 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cc13b474-636a-4642-a3fc-172a46f2f685 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:04.988172 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cc13b474-636a-4642-a3fc-172a46f2f685 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:04.988822 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cc13b474-636a-4642-a3fc-172a46f2f685 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:04.989530 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cc13b474-636a-4642-a3fc-172a46f2f685 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:04.989982 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cc13b474-636a-4642-a3fc-172a46f2f685 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:04.990423 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cc13b474-636a-4642-a3fc-172a46f2f685 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:05.130792 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-cc13b474-636a-4642-a3fc-172a46f2f685 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:05.139075 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-cc13b474-636a-4642-a3fc-172a46f2f685 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648" status: 200 len: 1522 microversion: 2.1 time: 0.162785 Sep 01 16:38:05.139844 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 112/232] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:04 2022] GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:06.160848 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-da7033a4-0785-4710-b398-a7c4c5f3ad89 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:06.161451 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-da7033a4-0785-4710-b398-a7c4c5f3ad89 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:06.168203 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-da7033a4-0785-4710-b398-a7c4c5f3ad89 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:06.169258 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-da7033a4-0785-4710-b398-a7c4c5f3ad89 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:06.169258 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-da7033a4-0785-4710-b398-a7c4c5f3ad89 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:06.169842 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-da7033a4-0785-4710-b398-a7c4c5f3ad89 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:06.170230 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-da7033a4-0785-4710-b398-a7c4c5f3ad89 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:06.170654 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-da7033a4-0785-4710-b398-a7c4c5f3ad89 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:06.319272 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-da7033a4-0785-4710-b398-a7c4c5f3ad89 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:06.329422 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-da7033a4-0785-4710-b398-a7c4c5f3ad89 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648" status: 200 len: 1522 microversion: 2.1 time: 0.172157 Sep 01 16:38:06.330193 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 121/233] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:06 2022] GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:07.358104 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-83711b7b-bc3b-4fa1-8829-00b27bad7667 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:07.358936 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-83711b7b-bc3b-4fa1-8829-00b27bad7667 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:07.368566 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-83711b7b-bc3b-4fa1-8829-00b27bad7667 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:07.369233 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-83711b7b-bc3b-4fa1-8829-00b27bad7667 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:07.369699 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-83711b7b-bc3b-4fa1-8829-00b27bad7667 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:07.370423 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-83711b7b-bc3b-4fa1-8829-00b27bad7667 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:07.370887 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-83711b7b-bc3b-4fa1-8829-00b27bad7667 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:07.371362 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-83711b7b-bc3b-4fa1-8829-00b27bad7667 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:07.517091 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-83711b7b-bc3b-4fa1-8829-00b27bad7667 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:07.527426 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-83711b7b-bc3b-4fa1-8829-00b27bad7667 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648" status: 200 len: 1522 microversion: 2.1 time: 0.174978 Sep 01 16:38:07.527939 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 113/234] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:07 2022] GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:08.548461 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0e8fbde3-ded4-4d12-9496-d71b7b2a376c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:08.549091 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-0e8fbde3-ded4-4d12-9496-d71b7b2a376c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:08.555576 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0e8fbde3-ded4-4d12-9496-d71b7b2a376c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:08.556115 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0e8fbde3-ded4-4d12-9496-d71b7b2a376c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:08.556578 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0e8fbde3-ded4-4d12-9496-d71b7b2a376c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:08.557564 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0e8fbde3-ded4-4d12-9496-d71b7b2a376c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:08.558208 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0e8fbde3-ded4-4d12-9496-d71b7b2a376c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:08.558628 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0e8fbde3-ded4-4d12-9496-d71b7b2a376c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:08.712232 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-0e8fbde3-ded4-4d12-9496-d71b7b2a376c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:08.721832 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-0e8fbde3-ded4-4d12-9496-d71b7b2a376c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648" status: 200 len: 1522 microversion: 2.1 time: 0.177346 Sep 01 16:38:08.722484 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 122/235] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:08 2022] GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:09.236890 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a275f0fb-3f84-460b-8078-1e4562f4be74 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1119082252", "imageRef": "49e5276c-002c-454f-8be8-76deb18b6b28", "flavorRef": "452"}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:09.301840 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.network.neutron [None req-a275f0fb-3f84-460b-8078-1e4562f4be74 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] validate_networks() for None {{(pid=127198) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:38:09.602955 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-a275f0fb-3f84-460b-8078-1e4562f4be74 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Flavor limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:38:09.603377 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-a275f0fb-3f84-460b-8078-1e4562f4be74 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Image limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:38:09.603853 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-a275f0fb-3f84-460b-8078-1e4562f4be74 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Flavor pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:38:09.604324 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-a275f0fb-3f84-460b-8078-1e4562f4be74 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Image pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:38:09.604730 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-a275f0fb-3f84-460b-8078-1e4562f4be74 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:38:09.614525 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a275f0fb-3f84-460b-8078-1e4562f4be74 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:09.615015 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a275f0fb-3f84-460b-8078-1e4562f4be74 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:09.615451 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a275f0fb-3f84-460b-8078-1e4562f4be74 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:09.616237 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a275f0fb-3f84-460b-8078-1e4562f4be74 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:09.616733 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a275f0fb-3f84-460b-8078-1e4562f4be74 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:09.617157 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a275f0fb-3f84-460b-8078-1e4562f4be74 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:09.634573 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-a275f0fb-3f84-460b-8078-1e4562f4be74 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Getting quotas for project b3c33dc11d9d41eabd986b4a4c536616. Resources: {'ram', 'cores', 'instances'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:38:09.639767 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-a275f0fb-3f84-460b-8078-1e4562f4be74 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Getting quotas for user 535e932c54904b83bfc19fd68df95116 and project b3c33dc11d9d41eabd986b4a4c536616. Resources: {'ram', 'cores', 'instances'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:38:09.651789 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a275f0fb-3f84-460b-8078-1e4562f4be74 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Going to run 1 instances... {{(pid=127198) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:38:09.654325 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a275f0fb-3f84-460b-8078-1e4562f4be74 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] [instance: 757d4563-fb3e-49ce-b98b-f2b522d66845] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='49e5276c-002c-454f-8be8-76deb18b6b28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:38:09.709415 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a275f0fb-3f84-460b-8078-1e4562f4be74 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.478903 Sep 01 16:38:09.710079 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 114/236] 10.222.0.62 () {60 vars in 1147 bytes} [Thu Sep 1 16:38:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 481 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:38:09.723668 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d6e63ac4-1aec-48d1-9e28-eee9f4332c37 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:09.724490 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d6e63ac4-1aec-48d1-9e28-eee9f4332c37 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] [instance: 757d4563-fb3e-49ce-b98b-f2b522d66845] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:09.744112 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d3ee0d27-c01a-4725-b2d3-b8067d7e6127 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:09.745079 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d3ee0d27-c01a-4725-b2d3-b8067d7e6127 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:09.753394 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d3ee0d27-c01a-4725-b2d3-b8067d7e6127 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:09.753893 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d3ee0d27-c01a-4725-b2d3-b8067d7e6127 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:09.754398 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d3ee0d27-c01a-4725-b2d3-b8067d7e6127 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:09.755301 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d3ee0d27-c01a-4725-b2d3-b8067d7e6127 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:09.755859 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d3ee0d27-c01a-4725-b2d3-b8067d7e6127 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:09.756507 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d3ee0d27-c01a-4725-b2d3-b8067d7e6127 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:09.819406 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d6e63ac4-1aec-48d1-9e28-eee9f4332c37 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535e932c54904b83bfc19fd68df95116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c33dc11d9d41eabd986b4a4c536616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:09.835083 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d6e63ac4-1aec-48d1-9e28-eee9f4332c37 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] 10.222.0.62 "GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845" status: 200 len: 1215 microversion: 2.1 time: 0.115589 Sep 01 16:38:09.836068 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 123/237] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:09 2022] GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845 => generated 1215 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:09.937365 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d3ee0d27-c01a-4725-b2d3-b8067d7e6127 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:09.956273 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d3ee0d27-c01a-4725-b2d3-b8067d7e6127 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648" status: 200 len: 1522 microversion: 2.1 time: 0.217220 Sep 01 16:38:09.956989 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 115/238] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:09 2022] GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:10.532302 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ac26166b-7ce0-452a-aade-b367f54c4956 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1137427804", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-16309676", "security_groups": [{"name": "tempest-secgroup-smoke-1149559819"}], "networks": [{"uuid": "d37cd4e1-bf6a-4bbb-9a90-1dc77ce379ef"}], "block_device_mapping_v2": [{"uuid": "8b591c98-7f6b-48f3-a131-f74b5311f5d4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:10.667909 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.network.neutron [None req-ac26166b-7ce0-452a-aade-b367f54c4956 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] validate_networks() for [('d37cd4e1-bf6a-4bbb-9a90-1dc77ce379ef', None, None, None, None, None)] {{(pid=127199) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:38:10.857388 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ddcd657c-372f-4802-b33e-ff1230b3fb08 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:10.858148 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ddcd657c-372f-4802-b33e-ff1230b3fb08 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] [instance: 757d4563-fb3e-49ce-b98b-f2b522d66845] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:10.865174 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ddcd657c-372f-4802-b33e-ff1230b3fb08 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:10.865680 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ddcd657c-372f-4802-b33e-ff1230b3fb08 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:10.866112 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ddcd657c-372f-4802-b33e-ff1230b3fb08 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:10.866841 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ddcd657c-372f-4802-b33e-ff1230b3fb08 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:10.867280 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ddcd657c-372f-4802-b33e-ff1230b3fb08 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:10.867744 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ddcd657c-372f-4802-b33e-ff1230b3fb08 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:10.875438 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=32 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:10.963482 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ddcd657c-372f-4802-b33e-ff1230b3fb08 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535e932c54904b83bfc19fd68df95116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c33dc11d9d41eabd986b4a4c536616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:10.974600 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ddcd657c-372f-4802-b33e-ff1230b3fb08 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] 10.222.0.62 "GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845" status: 200 len: 1267 microversion: 2.1 time: 0.121419 Sep 01 16:38:10.986761 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 116/239] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:10 2022] GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845 => generated 1267 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:10.986761 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3d556db4-8bf4-4bd4-8aaf-258d019c1b38 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:10.986761 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-3d556db4-8bf4-4bd4-8aaf-258d019c1b38 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:10.993229 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3d556db4-8bf4-4bd4-8aaf-258d019c1b38 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:10.994172 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3d556db4-8bf4-4bd4-8aaf-258d019c1b38 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:10.994629 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3d556db4-8bf4-4bd4-8aaf-258d019c1b38 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:10.996088 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3d556db4-8bf4-4bd4-8aaf-258d019c1b38 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:10.996949 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3d556db4-8bf4-4bd4-8aaf-258d019c1b38 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:10.998320 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3d556db4-8bf4-4bd4-8aaf-258d019c1b38 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:11.251573 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-ac26166b-7ce0-452a-aade-b367f54c4956 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Flavor limits 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:38:11.252412 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-ac26166b-7ce0-452a-aade-b367f54c4956 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Image limits 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:38:11.252875 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-ac26166b-7ce0-452a-aade-b367f54c4956 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Flavor pref 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:38:11.253587 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-ac26166b-7ce0-452a-aade-b367f54c4956 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Image pref 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:38:11.254263 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-ac26166b-7ce0-452a-aade-b367f54c4956 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:38:11.264570 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac26166b-7ce0-452a-aade-b367f54c4956 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:11.265348 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac26166b-7ce0-452a-aade-b367f54c4956 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:11.265964 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac26166b-7ce0-452a-aade-b367f54c4956 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:11.267028 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac26166b-7ce0-452a-aade-b367f54c4956 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:11.267668 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac26166b-7ce0-452a-aade-b367f54c4956 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:11.268118 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac26166b-7ce0-452a-aade-b367f54c4956 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:11.289005 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-ac26166b-7ce0-452a-aade-b367f54c4956 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Getting quotas for project d5df463e3a1640ec8041d2b4bb6311f2. Resources: {'ram', 'cores', 'instances'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:38:11.296998 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3d556db4-8bf4-4bd4-8aaf-258d019c1b38 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:11.306831 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-ac26166b-7ce0-452a-aade-b367f54c4956 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Getting quotas for user da359f520a9d411eb52da5700c07f8d7 and project d5df463e3a1640ec8041d2b4bb6311f2. Resources: {'ram', 'cores', 'instances'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:38:11.309030 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3d556db4-8bf4-4bd4-8aaf-258d019c1b38 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648" status: 200 len: 1522 microversion: 2.1 time: 0.331642 Sep 01 16:38:11.313603 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 117/240] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:10 2022] GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648 => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:11.482079 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ac26166b-7ce0-452a-aade-b367f54c4956 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Going to run 1 instances... {{(pid=127199) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:38:11.484999 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ac26166b-7ce0-452a-aade-b367f54c4956 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8b591c98-7f6b-48f3-a131-f74b5311f5d4',volume_size=None,volume_type=None)] {{(pid=127199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:38:11.673904 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ac26166b-7ce0-452a-aade-b367f54c4956 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.145597 Sep 01 16:38:11.674572 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 124/241] 10.222.0.62 () {60 vars in 1147 bytes} [Thu Sep 1 16:38:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 1147 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:38:11.692560 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3d87a29d-d1c9-4124-b092-d3b288f7f5fb tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:11.693245 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-3d87a29d-d1c9-4124-b092-d3b288f7f5fb tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:11.782721 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3d87a29d-d1c9-4124-b092-d3b288f7f5fb tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:11.797846 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3d87a29d-d1c9-4124-b092-d3b288f7f5fb tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1087 microversion: 2.1 time: 0.114693 Sep 01 16:38:11.798675 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 118/242] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:11 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1087 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:12.000227 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-09b48f4c-577b-4c68-939b-5cf81ba602fb tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:12.001937 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-09b48f4c-577b-4c68-939b-5cf81ba602fb tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] [instance: 757d4563-fb3e-49ce-b98b-f2b522d66845] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:12.023635 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-09b48f4c-577b-4c68-939b-5cf81ba602fb tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:12.024279 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-09b48f4c-577b-4c68-939b-5cf81ba602fb tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:12.024709 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-09b48f4c-577b-4c68-939b-5cf81ba602fb tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:12.025438 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-09b48f4c-577b-4c68-939b-5cf81ba602fb tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:12.025956 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-09b48f4c-577b-4c68-939b-5cf81ba602fb tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:12.030480 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-09b48f4c-577b-4c68-939b-5cf81ba602fb tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:12.139258 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-09b48f4c-577b-4c68-939b-5cf81ba602fb tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535e932c54904b83bfc19fd68df95116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c33dc11d9d41eabd986b4a4c536616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:12.150128 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-09b48f4c-577b-4c68-939b-5cf81ba602fb tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] 10.222.0.62 "GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845" status: 200 len: 1273 microversion: 2.1 time: 0.154134 Sep 01 16:38:12.150778 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 125/243] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:11 2022] GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845 => generated 1273 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:12.340356 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0d2a54d5-9587-4610-8904-44c9d96f376a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:12.341143 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0d2a54d5-9587-4610-8904-44c9d96f376a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:12.349706 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0d2a54d5-9587-4610-8904-44c9d96f376a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:12.350177 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0d2a54d5-9587-4610-8904-44c9d96f376a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:12.350618 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0d2a54d5-9587-4610-8904-44c9d96f376a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:12.351404 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0d2a54d5-9587-4610-8904-44c9d96f376a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:12.356714 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0d2a54d5-9587-4610-8904-44c9d96f376a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:12.356714 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0d2a54d5-9587-4610-8904-44c9d96f376a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:12.508756 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0d2a54d5-9587-4610-8904-44c9d96f376a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:12.517338 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0d2a54d5-9587-4610-8904-44c9d96f376a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648" status: 200 len: 1522 microversion: 2.1 time: 0.181015 Sep 01 16:38:12.518173 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 119/244] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:12 2022] GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:12.820481 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-f158cb4e-89d0-4358-98ee-1e1d5373a8c9 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:12.822024 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-f158cb4e-89d0-4358-98ee-1e1d5373a8c9 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:12.834264 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f158cb4e-89d0-4358-98ee-1e1d5373a8c9 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:12.834749 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f158cb4e-89d0-4358-98ee-1e1d5373a8c9 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:12.835181 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f158cb4e-89d0-4358-98ee-1e1d5373a8c9 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:12.835873 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f158cb4e-89d0-4358-98ee-1e1d5373a8c9 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:12.836347 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f158cb4e-89d0-4358-98ee-1e1d5373a8c9 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:12.836757 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f158cb4e-89d0-4358-98ee-1e1d5373a8c9 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:12.902151 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-f158cb4e-89d0-4358-98ee-1e1d5373a8c9 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:12.910910 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-f158cb4e-89d0-4358-98ee-1e1d5373a8c9 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1137 microversion: 2.1 time: 0.095604 Sep 01 16:38:12.911555 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 126/245] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:12 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1137 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:13.171546 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2deb253c-b772-4e72-8847-1667cdef4b00 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:13.172378 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-2deb253c-b772-4e72-8847-1667cdef4b00 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] [instance: 757d4563-fb3e-49ce-b98b-f2b522d66845] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:13.179493 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2deb253c-b772-4e72-8847-1667cdef4b00 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:13.180008 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2deb253c-b772-4e72-8847-1667cdef4b00 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:13.180444 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2deb253c-b772-4e72-8847-1667cdef4b00 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:13.181150 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2deb253c-b772-4e72-8847-1667cdef4b00 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:13.181628 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2deb253c-b772-4e72-8847-1667cdef4b00 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:13.182130 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2deb253c-b772-4e72-8847-1667cdef4b00 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:13.484667 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2deb253c-b772-4e72-8847-1667cdef4b00 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535e932c54904b83bfc19fd68df95116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c33dc11d9d41eabd986b4a4c536616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:13.501101 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2deb253c-b772-4e72-8847-1667cdef4b00 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] 10.222.0.62 "GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845" status: 200 len: 1315 microversion: 2.1 time: 0.333780 Sep 01 16:38:13.501859 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 120/246] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:13 2022] GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845 => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:13.548866 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-da844aa1-c3af-49cb-a670-0a35d2f109cd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:13.550194 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-da844aa1-c3af-49cb-a670-0a35d2f109cd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:13.558712 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-da844aa1-c3af-49cb-a670-0a35d2f109cd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:13.559107 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-da844aa1-c3af-49cb-a670-0a35d2f109cd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:13.559501 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-da844aa1-c3af-49cb-a670-0a35d2f109cd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:13.560259 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-da844aa1-c3af-49cb-a670-0a35d2f109cd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:13.560715 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-da844aa1-c3af-49cb-a670-0a35d2f109cd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:13.561135 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-da844aa1-c3af-49cb-a670-0a35d2f109cd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:13.731283 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-da844aa1-c3af-49cb-a670-0a35d2f109cd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:13.740332 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-da844aa1-c3af-49cb-a670-0a35d2f109cd tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648" status: 200 len: 1522 microversion: 2.1 time: 0.195566 Sep 01 16:38:13.740919 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 127/247] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:13 2022] GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:13.933390 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f5759db5-e0ca-4b73-a195-1b75286a7cc5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:13.933985 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f5759db5-e0ca-4b73-a195-1b75286a7cc5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:13.940399 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f5759db5-e0ca-4b73-a195-1b75286a7cc5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:13.940904 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f5759db5-e0ca-4b73-a195-1b75286a7cc5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:13.941363 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f5759db5-e0ca-4b73-a195-1b75286a7cc5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:13.942036 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f5759db5-e0ca-4b73-a195-1b75286a7cc5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:13.942507 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f5759db5-e0ca-4b73-a195-1b75286a7cc5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:13.942937 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f5759db5-e0ca-4b73-a195-1b75286a7cc5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:14.015581 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f5759db5-e0ca-4b73-a195-1b75286a7cc5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:14.025597 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f5759db5-e0ca-4b73-a195-1b75286a7cc5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1137 microversion: 2.1 time: 0.096391 Sep 01 16:38:14.026336 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 121/248] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:13 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1137 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:14.526051 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-87cbfb6d-de86-4c37-b2c5-3bc5f01f7e9b tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:14.526730 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-87cbfb6d-de86-4c37-b2c5-3bc5f01f7e9b tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] [instance: 757d4563-fb3e-49ce-b98b-f2b522d66845] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:14.535407 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-87cbfb6d-de86-4c37-b2c5-3bc5f01f7e9b tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:14.536052 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-87cbfb6d-de86-4c37-b2c5-3bc5f01f7e9b tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:14.536489 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-87cbfb6d-de86-4c37-b2c5-3bc5f01f7e9b tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:14.537314 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-87cbfb6d-de86-4c37-b2c5-3bc5f01f7e9b tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:14.538047 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-87cbfb6d-de86-4c37-b2c5-3bc5f01f7e9b tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:14.538482 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-87cbfb6d-de86-4c37-b2c5-3bc5f01f7e9b tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:14.772221 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8763db1c-932d-4551-9951-aae544e62c35 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:14.773487 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8763db1c-932d-4551-9951-aae544e62c35 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:14.781383 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:14.783849 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8763db1c-932d-4551-9951-aae544e62c35 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:14.784539 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8763db1c-932d-4551-9951-aae544e62c35 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:14.784999 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8763db1c-932d-4551-9951-aae544e62c35 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:14.786050 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8763db1c-932d-4551-9951-aae544e62c35 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:14.786521 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8763db1c-932d-4551-9951-aae544e62c35 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:14.786950 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8763db1c-932d-4551-9951-aae544e62c35 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:15.131445 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-87cbfb6d-de86-4c37-b2c5-3bc5f01f7e9b tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535e932c54904b83bfc19fd68df95116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c33dc11d9d41eabd986b4a4c536616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:15.140224 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-87cbfb6d-de86-4c37-b2c5-3bc5f01f7e9b tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] 10.222.0.62 "GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845" status: 200 len: 1315 microversion: 2.1 time: 0.620980 Sep 01 16:38:15.140801 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 128/249] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:14 2022] GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845 => generated 1315 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:15.145581 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7b6238be-bdee-48d7-9e99-e99f56719bac tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:15.146365 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-7b6238be-bdee-48d7-9e99-e99f56719bac tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:15.153406 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7b6238be-bdee-48d7-9e99-e99f56719bac tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:15.153931 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7b6238be-bdee-48d7-9e99-e99f56719bac tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:15.154361 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7b6238be-bdee-48d7-9e99-e99f56719bac tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:15.155067 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7b6238be-bdee-48d7-9e99-e99f56719bac tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:15.155525 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7b6238be-bdee-48d7-9e99-e99f56719bac tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:15.156078 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7b6238be-bdee-48d7-9e99-e99f56719bac tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:15.179664 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8763db1c-932d-4551-9951-aae544e62c35 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:15.188181 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8763db1c-932d-4551-9951-aae544e62c35 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648" status: 200 len: 1522 microversion: 2.1 time: 0.428812 Sep 01 16:38:15.188863 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 122/250] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:14 2022] GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648 => generated 1522 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:15.240222 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-7b6238be-bdee-48d7-9e99-e99f56719bac tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:15.248532 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-7b6238be-bdee-48d7-9e99-e99f56719bac tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1185 microversion: 2.1 time: 0.106740 Sep 01 16:38:15.249222 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 129/251] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:15 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:15.494101 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-e93cb9b8-dead-4c0f-a1ca-74cd9b84c183 req-dfb4378d-9a4d-4555-8aee-838a1662630b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "757d4563-fb3e-49ce-b98b-f2b522d66845", "tag": "4500feb8-e551-4e82-bfe1-08ba5a216dd6"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:15.503839 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-e93cb9b8-dead-4c0f-a1ca-74cd9b84c183 req-dfb4378d-9a4d-4555-8aee-838a1662630b service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:15.504342 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-e93cb9b8-dead-4c0f-a1ca-74cd9b84c183 req-dfb4378d-9a4d-4555-8aee-838a1662630b service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:15.504773 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-e93cb9b8-dead-4c0f-a1ca-74cd9b84c183 req-dfb4378d-9a4d-4555-8aee-838a1662630b service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:15.516410 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-e93cb9b8-dead-4c0f-a1ca-74cd9b84c183 req-dfb4378d-9a4d-4555-8aee-838a1662630b service nova] Creating event network-changed:4500feb8-e551-4e82-bfe1-08ba5a216dd6 for instance 757d4563-fb3e-49ce-b98b-f2b522d66845 on hv-cinder-85221 Sep 01 16:38:15.521520 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-e93cb9b8-dead-4c0f-a1ca-74cd9b84c183 req-dfb4378d-9a4d-4555-8aee-838a1662630b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031049 Sep 01 16:38:15.522148 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 123/252] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:38:16.161992 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-84e8d5c5-aafc-4d42-9c65-af012fdd160b tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:16.162634 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-84e8d5c5-aafc-4d42-9c65-af012fdd160b tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] [instance: 757d4563-fb3e-49ce-b98b-f2b522d66845] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:16.168903 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-84e8d5c5-aafc-4d42-9c65-af012fdd160b tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:16.169379 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-84e8d5c5-aafc-4d42-9c65-af012fdd160b tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:16.169804 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-84e8d5c5-aafc-4d42-9c65-af012fdd160b tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:16.170499 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-84e8d5c5-aafc-4d42-9c65-af012fdd160b tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:16.170953 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-84e8d5c5-aafc-4d42-9c65-af012fdd160b tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:16.171370 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-84e8d5c5-aafc-4d42-9c65-af012fdd160b tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:16.211949 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c9d6a561-22c7-4156-8c1b-acd6e8c75e7b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:16.212956 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c9d6a561-22c7-4156-8c1b-acd6e8c75e7b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:16.222192 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c9d6a561-22c7-4156-8c1b-acd6e8c75e7b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:16.222677 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c9d6a561-22c7-4156-8c1b-acd6e8c75e7b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:16.223102 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c9d6a561-22c7-4156-8c1b-acd6e8c75e7b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:16.223803 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c9d6a561-22c7-4156-8c1b-acd6e8c75e7b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:16.224278 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c9d6a561-22c7-4156-8c1b-acd6e8c75e7b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:16.224694 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c9d6a561-22c7-4156-8c1b-acd6e8c75e7b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:16.389611 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-84e8d5c5-aafc-4d42-9c65-af012fdd160b tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535e932c54904b83bfc19fd68df95116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c33dc11d9d41eabd986b4a4c536616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:16.397459 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-84e8d5c5-aafc-4d42-9c65-af012fdd160b tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] 10.222.0.62 "GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845" status: 200 len: 1315 microversion: 2.1 time: 0.239383 Sep 01 16:38:16.398034 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 130/253] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:16 2022] GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:16.403145 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-15336054-9c72-4e0d-91e8-d4263c6443ad tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:16.403357 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-15336054-9c72-4e0d-91e8-d4263c6443ad tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:16.409932 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-15336054-9c72-4e0d-91e8-d4263c6443ad tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:16.410486 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-15336054-9c72-4e0d-91e8-d4263c6443ad tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:16.410972 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-15336054-9c72-4e0d-91e8-d4263c6443ad tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:16.411677 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-15336054-9c72-4e0d-91e8-d4263c6443ad tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:16.412193 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-15336054-9c72-4e0d-91e8-d4263c6443ad tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:16.412544 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-15336054-9c72-4e0d-91e8-d4263c6443ad tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:16.419797 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c9d6a561-22c7-4156-8c1b-acd6e8c75e7b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:16.422269 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:16.429273 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c9d6a561-22c7-4156-8c1b-acd6e8c75e7b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648" status: 200 len: 1522 microversion: 2.1 time: 0.222116 Sep 01 16:38:16.429943 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 124/254] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:16 2022] GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:16.475289 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-15336054-9c72-4e0d-91e8-d4263c6443ad tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:16.483507 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-15336054-9c72-4e0d-91e8-d4263c6443ad tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1185 microversion: 2.1 time: 0.084466 Sep 01 16:38:16.484131 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 131/255] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:16 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:16.585213 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f1b47ccf-da79-450b-a66e-062b0b2fa78f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:16.586036 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f1b47ccf-da79-450b-a66e-062b0b2fa78f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:16.593549 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f1b47ccf-da79-450b-a66e-062b0b2fa78f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:16.594083 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f1b47ccf-da79-450b-a66e-062b0b2fa78f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:16.594517 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f1b47ccf-da79-450b-a66e-062b0b2fa78f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:16.595218 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f1b47ccf-da79-450b-a66e-062b0b2fa78f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:16.595678 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f1b47ccf-da79-450b-a66e-062b0b2fa78f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:16.596136 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f1b47ccf-da79-450b-a66e-062b0b2fa78f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:16.620971 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f1b47ccf-da79-450b-a66e-062b0b2fa78f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a/ips" status: 200 len: 153 microversion: 2.20 time: 0.042373 Sep 01 16:38:16.621557 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 125/256] 10.222.0.62 () {60 vars in 1289 bytes} [Thu Sep 1 16:38:16 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a/ips => generated 153 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:38:17.419492 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-4c5716c4-52b6-4d54-af06-a036c6320c78 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:17.420092 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-4c5716c4-52b6-4d54-af06-a036c6320c78 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] [instance: 757d4563-fb3e-49ce-b98b-f2b522d66845] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:17.426807 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4c5716c4-52b6-4d54-af06-a036c6320c78 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:17.427301 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4c5716c4-52b6-4d54-af06-a036c6320c78 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:17.427726 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4c5716c4-52b6-4d54-af06-a036c6320c78 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:17.428444 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4c5716c4-52b6-4d54-af06-a036c6320c78 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:17.428901 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4c5716c4-52b6-4d54-af06-a036c6320c78 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:17.429316 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4c5716c4-52b6-4d54-af06-a036c6320c78 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:17.451263 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0e33e4a2-4bd4-446c-a37e-8e62b4f32772 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:17.452021 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0e33e4a2-4bd4-446c-a37e-8e62b4f32772 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:17.459010 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0e33e4a2-4bd4-446c-a37e-8e62b4f32772 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:17.459500 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0e33e4a2-4bd4-446c-a37e-8e62b4f32772 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:17.459933 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0e33e4a2-4bd4-446c-a37e-8e62b4f32772 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:17.460663 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0e33e4a2-4bd4-446c-a37e-8e62b4f32772 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:17.461121 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0e33e4a2-4bd4-446c-a37e-8e62b4f32772 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:17.461527 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0e33e4a2-4bd4-446c-a37e-8e62b4f32772 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:17.611784 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-4c5716c4-52b6-4d54-af06-a036c6320c78 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535e932c54904b83bfc19fd68df95116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c33dc11d9d41eabd986b4a4c536616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:17.620083 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-4c5716c4-52b6-4d54-af06-a036c6320c78 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] 10.222.0.62 "GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845" status: 200 len: 1315 microversion: 2.1 time: 0.204438 Sep 01 16:38:17.620744 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 132/257] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:17 2022] GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:17.625275 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-867f5118-d0a7-4d42-acf6-86fb50a02080 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:17.625876 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-867f5118-d0a7-4d42-acf6-86fb50a02080 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:17.632156 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-867f5118-d0a7-4d42-acf6-86fb50a02080 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:17.632851 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-867f5118-d0a7-4d42-acf6-86fb50a02080 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:17.633054 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-867f5118-d0a7-4d42-acf6-86fb50a02080 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:17.634110 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-867f5118-d0a7-4d42-acf6-86fb50a02080 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:17.634804 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-867f5118-d0a7-4d42-acf6-86fb50a02080 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:17.635514 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-867f5118-d0a7-4d42-acf6-86fb50a02080 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:17.644213 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0e33e4a2-4bd4-446c-a37e-8e62b4f32772 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:17.653013 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0e33e4a2-4bd4-446c-a37e-8e62b4f32772 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648" status: 200 len: 1522 microversion: 2.1 time: 0.205917 Sep 01 16:38:17.653590 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 126/258] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:17 2022] GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:17.727675 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-867f5118-d0a7-4d42-acf6-86fb50a02080 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:17.736427 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-867f5118-d0a7-4d42-acf6-86fb50a02080 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1185 microversion: 2.1 time: 0.114559 Sep 01 16:38:17.737566 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 133/259] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:17 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:18.641413 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-962ebe0c-b8c6-445b-acbe-652000a7b6e9 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:18.642108 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-962ebe0c-b8c6-445b-acbe-652000a7b6e9 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] [instance: 757d4563-fb3e-49ce-b98b-f2b522d66845] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:18.649096 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-962ebe0c-b8c6-445b-acbe-652000a7b6e9 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:18.649649 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-962ebe0c-b8c6-445b-acbe-652000a7b6e9 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:18.650112 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-962ebe0c-b8c6-445b-acbe-652000a7b6e9 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:18.651225 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-962ebe0c-b8c6-445b-acbe-652000a7b6e9 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:18.651860 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-962ebe0c-b8c6-445b-acbe-652000a7b6e9 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:18.652313 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-962ebe0c-b8c6-445b-acbe-652000a7b6e9 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:18.675592 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-3853263e-bdb8-4331-ba49-09fb9c62c636 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:18.677738 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-3853263e-bdb8-4331-ba49-09fb9c62c636 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:18.685453 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3853263e-bdb8-4331-ba49-09fb9c62c636 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:18.686196 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3853263e-bdb8-4331-ba49-09fb9c62c636 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:18.686978 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3853263e-bdb8-4331-ba49-09fb9c62c636 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:18.687680 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3853263e-bdb8-4331-ba49-09fb9c62c636 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:18.688146 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3853263e-bdb8-4331-ba49-09fb9c62c636 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:18.688570 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3853263e-bdb8-4331-ba49-09fb9c62c636 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:18.691948 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=100 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:19.269205 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-962ebe0c-b8c6-445b-acbe-652000a7b6e9 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535e932c54904b83bfc19fd68df95116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c33dc11d9d41eabd986b4a4c536616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:19.282045 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-962ebe0c-b8c6-445b-acbe-652000a7b6e9 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] 10.222.0.62 "GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845" status: 200 len: 1315 microversion: 2.1 time: 0.644519 Sep 01 16:38:19.282939 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 127/260] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:18 2022] GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845 => generated 1315 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:19.288588 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a612c473-72fa-4a02-beac-dec0b1de4c5e tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:19.289290 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a612c473-72fa-4a02-beac-dec0b1de4c5e tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:19.296972 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a612c473-72fa-4a02-beac-dec0b1de4c5e tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:19.297685 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a612c473-72fa-4a02-beac-dec0b1de4c5e tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:19.298482 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a612c473-72fa-4a02-beac-dec0b1de4c5e tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:19.299541 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a612c473-72fa-4a02-beac-dec0b1de4c5e tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:19.300356 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a612c473-72fa-4a02-beac-dec0b1de4c5e tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:19.300857 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a612c473-72fa-4a02-beac-dec0b1de4c5e tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:19.300975 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-3853263e-bdb8-4331-ba49-09fb9c62c636 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:19.316106 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-3853263e-bdb8-4331-ba49-09fb9c62c636 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648" status: 200 len: 1522 microversion: 2.1 time: 0.644037 Sep 01 16:38:19.329252 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 134/261] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:18 2022] GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648 => generated 1522 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:19.433536 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a612c473-72fa-4a02-beac-dec0b1de4c5e tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:19.453156 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a612c473-72fa-4a02-beac-dec0b1de4c5e tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1191 microversion: 2.1 time: 0.167268 Sep 01 16:38:19.455376 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 128/262] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:19 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1191 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:19.645136 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-4a536ea9-faa8-4a56-8eaa-61703a174f41 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:19.645846 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-4a536ea9-faa8-4a56-8eaa-61703a174f41 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:19.653213 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4a536ea9-faa8-4a56-8eaa-61703a174f41 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:19.653841 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4a536ea9-faa8-4a56-8eaa-61703a174f41 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:19.654369 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4a536ea9-faa8-4a56-8eaa-61703a174f41 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:19.655156 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4a536ea9-faa8-4a56-8eaa-61703a174f41 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:19.655819 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4a536ea9-faa8-4a56-8eaa-61703a174f41 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:19.656334 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4a536ea9-faa8-4a56-8eaa-61703a174f41 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:19.683846 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-4a536ea9-faa8-4a56-8eaa-61703a174f41 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037/ips" status: 200 len: 147 microversion: 2.1 time: 0.042609 Sep 01 16:38:19.685557 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 135/263] 10.222.0.62 () {58 vars in 1248 bytes} [Thu Sep 1 16:38:19 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037/ips => generated 147 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:38:20.254600 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-61552d2f-545a-4b6a-8bda-9bea6a8cc382 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:20.255123 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-61552d2f-545a-4b6a-8bda-9bea6a8cc382 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:20.266959 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:20.269638 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-61552d2f-545a-4b6a-8bda-9bea6a8cc382 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:20.270119 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-61552d2f-545a-4b6a-8bda-9bea6a8cc382 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:20.270769 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-61552d2f-545a-4b6a-8bda-9bea6a8cc382 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:20.271643 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-61552d2f-545a-4b6a-8bda-9bea6a8cc382 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:20.272306 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-61552d2f-545a-4b6a-8bda-9bea6a8cc382 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:20.273120 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-61552d2f-545a-4b6a-8bda-9bea6a8cc382 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:20.300832 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-61552d2f-545a-4b6a-8bda-9bea6a8cc382 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lazy-loading 'flavor' on Instance uuid 8ddc2614-8a62-4c61-a086-8dbab65e1f4a {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:38:20.304172 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e424dbb5-ab1b-4681-a499-5e84df1e8925 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:20.305008 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e424dbb5-ab1b-4681-a499-5e84df1e8925 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] [instance: 757d4563-fb3e-49ce-b98b-f2b522d66845] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:20.313694 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e424dbb5-ab1b-4681-a499-5e84df1e8925 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:20.314439 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e424dbb5-ab1b-4681-a499-5e84df1e8925 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:20.315340 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e424dbb5-ab1b-4681-a499-5e84df1e8925 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:20.316272 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e424dbb5-ab1b-4681-a499-5e84df1e8925 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:20.316944 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e424dbb5-ab1b-4681-a499-5e84df1e8925 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:20.317562 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e424dbb5-ab1b-4681-a499-5e84df1e8925 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:20.469142 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-e424dbb5-ab1b-4681-a499-5e84df1e8925 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535e932c54904b83bfc19fd68df95116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c33dc11d9d41eabd986b4a4c536616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:20.477428 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e424dbb5-ab1b-4681-a499-5e84df1e8925 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] 10.222.0.62 "GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845" status: 200 len: 1315 microversion: 2.1 time: 0.178175 Sep 01 16:38:20.479658 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 136/264] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:20 2022] GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:20.492416 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-467a94e2-6355-4881-a9ef-93cfff0ae3fe tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:20.493395 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-467a94e2-6355-4881-a9ef-93cfff0ae3fe tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:20.519697 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-467a94e2-6355-4881-a9ef-93cfff0ae3fe tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:20.521268 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-467a94e2-6355-4881-a9ef-93cfff0ae3fe tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:20.524213 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-467a94e2-6355-4881-a9ef-93cfff0ae3fe tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:20.525217 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-467a94e2-6355-4881-a9ef-93cfff0ae3fe tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:20.528459 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-467a94e2-6355-4881-a9ef-93cfff0ae3fe tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:20.529291 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-467a94e2-6355-4881-a9ef-93cfff0ae3fe tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:20.579812 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-61552d2f-545a-4b6a-8bda-9bea6a8cc382 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "POST /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a/action" status: 202 len: 0 microversion: 2.20 time: 0.331688 Sep 01 16:38:20.586711 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 129/265] 10.222.0.62 () {62 vars in 1319 bytes} [Thu Sep 1 16:38:20 2022] POST /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:38:20.596873 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f6d1b655-4ea0-46dd-9cd1-d7cec9c88a74 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:20.597970 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f6d1b655-4ea0-46dd-9cd1-d7cec9c88a74 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:20.605555 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f6d1b655-4ea0-46dd-9cd1-d7cec9c88a74 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:20.606206 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f6d1b655-4ea0-46dd-9cd1-d7cec9c88a74 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:20.607878 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f6d1b655-4ea0-46dd-9cd1-d7cec9c88a74 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:20.609045 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f6d1b655-4ea0-46dd-9cd1-d7cec9c88a74 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:20.609761 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f6d1b655-4ea0-46dd-9cd1-d7cec9c88a74 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:20.610293 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f6d1b655-4ea0-46dd-9cd1-d7cec9c88a74 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:20.845085 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-467a94e2-6355-4881-a9ef-93cfff0ae3fe tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:20.856474 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-467a94e2-6355-4881-a9ef-93cfff0ae3fe tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648" status: 200 len: 1522 microversion: 2.1 time: 0.376282 Sep 01 16:38:20.857297 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 137/266] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:20 2022] GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648 => generated 1522 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:20.862825 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-703f2351-a514-4783-9731-982e973bcd3f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:20.863762 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-703f2351-a514-4783-9731-982e973bcd3f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:20.871362 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-703f2351-a514-4783-9731-982e973bcd3f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:20.872485 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-703f2351-a514-4783-9731-982e973bcd3f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:20.873734 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-703f2351-a514-4783-9731-982e973bcd3f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:20.874787 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-703f2351-a514-4783-9731-982e973bcd3f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:20.875462 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-703f2351-a514-4783-9731-982e973bcd3f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:20.876187 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-703f2351-a514-4783-9731-982e973bcd3f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:20.954856 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f6d1b655-4ea0-46dd-9cd1-d7cec9c88a74 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:20.968971 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f6d1b655-4ea0-46dd-9cd1-d7cec9c88a74 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1259 microversion: 2.1 time: 0.380066 Sep 01 16:38:20.970194 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 130/267] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:20 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1259 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:21.117844 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-703f2351-a514-4783-9731-982e973bcd3f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:21.136209 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-703f2351-a514-4783-9731-982e973bcd3f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:21.138748 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-703f2351-a514-4783-9731-982e973bcd3f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:21.141822 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-703f2351-a514-4783-9731-982e973bcd3f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1725 microversion: 2.20 time: 0.283315 Sep 01 16:38:21.143784 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 138/268] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:20 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1725 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:21.502714 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7d64c30b-ad91-4e3d-a35d-adbbab3e89f0 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:21.504037 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7d64c30b-ad91-4e3d-a35d-adbbab3e89f0 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] [instance: 757d4563-fb3e-49ce-b98b-f2b522d66845] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:21.511572 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7d64c30b-ad91-4e3d-a35d-adbbab3e89f0 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:21.514448 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7d64c30b-ad91-4e3d-a35d-adbbab3e89f0 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:21.515112 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7d64c30b-ad91-4e3d-a35d-adbbab3e89f0 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:21.516141 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7d64c30b-ad91-4e3d-a35d-adbbab3e89f0 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:21.516663 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7d64c30b-ad91-4e3d-a35d-adbbab3e89f0 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:21.517089 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7d64c30b-ad91-4e3d-a35d-adbbab3e89f0 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:21.790847 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=8 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:21.796243 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7d64c30b-ad91-4e3d-a35d-adbbab3e89f0 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535e932c54904b83bfc19fd68df95116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c33dc11d9d41eabd986b4a4c536616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:21.809021 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7d64c30b-ad91-4e3d-a35d-adbbab3e89f0 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] 10.222.0.62 "GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845" status: 200 len: 1315 microversion: 2.1 time: 0.309897 Sep 01 16:38:21.809998 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 131/269] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:21 2022] GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845 => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:21.881068 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-93c56829-fd4c-453e-923f-442c94bdcaff tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:21.882095 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-93c56829-fd4c-453e-923f-442c94bdcaff tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:21.883728 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=2 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:21.884477 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=8 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:21.897212 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-93c56829-fd4c-453e-923f-442c94bdcaff tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:21.897846 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-93c56829-fd4c-453e-923f-442c94bdcaff tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:21.898273 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-93c56829-fd4c-453e-923f-442c94bdcaff tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:21.898975 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-93c56829-fd4c-453e-923f-442c94bdcaff tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:21.899423 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-93c56829-fd4c-453e-923f-442c94bdcaff tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:21.900340 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-93c56829-fd4c-453e-923f-442c94bdcaff tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:21.931363 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-e6e83019-0079-493c-bfd4-2c3818c39b55 req-f7f983b6-d889-4d58-b272-b7a942ee93b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca59565d-e140-4bf0-9ef3-9cc18f4d3068", "tag": "c9213b9e-d8d2-4cdc-b268-1f9f700f72ec"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:21.942290 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-e6e83019-0079-493c-bfd4-2c3818c39b55 req-f7f983b6-d889-4d58-b272-b7a942ee93b5 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:21.942914 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-e6e83019-0079-493c-bfd4-2c3818c39b55 req-f7f983b6-d889-4d58-b272-b7a942ee93b5 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:21.943511 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-e6e83019-0079-493c-bfd4-2c3818c39b55 req-f7f983b6-d889-4d58-b272-b7a942ee93b5 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:21.955821 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-e6e83019-0079-493c-bfd4-2c3818c39b55 req-f7f983b6-d889-4d58-b272-b7a942ee93b5 service nova] Creating event network-changed:c9213b9e-d8d2-4cdc-b268-1f9f700f72ec for instance ca59565d-e140-4bf0-9ef3-9cc18f4d3068 on hv-cinder-85221 Sep 01 16:38:21.961401 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-e6e83019-0079-493c-bfd4-2c3818c39b55 req-f7f983b6-d889-4d58-b272-b7a942ee93b5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033608 Sep 01 16:38:21.961997 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 132/270] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:38:21.992527 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e0589165-e193-4eb2-a4fb-a8f82a438809 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:21.993477 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e0589165-e193-4eb2-a4fb-a8f82a438809 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:22.002393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e0589165-e193-4eb2-a4fb-a8f82a438809 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:22.003831 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e0589165-e193-4eb2-a4fb-a8f82a438809 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:22.006825 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e0589165-e193-4eb2-a4fb-a8f82a438809 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:22.008025 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e0589165-e193-4eb2-a4fb-a8f82a438809 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:22.008710 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e0589165-e193-4eb2-a4fb-a8f82a438809 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:22.009600 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e0589165-e193-4eb2-a4fb-a8f82a438809 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:22.225811 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-93c56829-fd4c-453e-923f-442c94bdcaff tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:22.241866 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-93c56829-fd4c-453e-923f-442c94bdcaff tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648" status: 200 len: 1522 microversion: 2.1 time: 0.365599 Sep 01 16:38:22.242496 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 139/271] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:21 2022] GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648 => generated 1522 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:22.247485 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ff97dbe1-9270-41fd-99f8-c121af479647 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:22.248477 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ff97dbe1-9270-41fd-99f8-c121af479647 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:22.265266 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ff97dbe1-9270-41fd-99f8-c121af479647 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:22.266056 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ff97dbe1-9270-41fd-99f8-c121af479647 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:22.266492 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ff97dbe1-9270-41fd-99f8-c121af479647 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:22.267223 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ff97dbe1-9270-41fd-99f8-c121af479647 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:22.267674 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ff97dbe1-9270-41fd-99f8-c121af479647 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:22.268322 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ff97dbe1-9270-41fd-99f8-c121af479647 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:22.305703 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e0589165-e193-4eb2-a4fb-a8f82a438809 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:22.314879 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e0589165-e193-4eb2-a4fb-a8f82a438809 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1259 microversion: 2.1 time: 0.326335 Sep 01 16:38:22.316002 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 133/272] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:21 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1259 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:22.321125 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a13161cc-f3ab-4aae-89ad-60b31cd88bcb tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61cd3bef-c32f-408d-b7ee-fdd8ba47e125"}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:22.323924 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a13161cc-f3ab-4aae-89ad-60b31cd88bcb tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:22.330564 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a13161cc-f3ab-4aae-89ad-60b31cd88bcb tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:22.331053 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a13161cc-f3ab-4aae-89ad-60b31cd88bcb tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:22.331507 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a13161cc-f3ab-4aae-89ad-60b31cd88bcb tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:22.332246 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a13161cc-f3ab-4aae-89ad-60b31cd88bcb tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:22.332704 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a13161cc-f3ab-4aae-89ad-60b31cd88bcb tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:22.333125 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a13161cc-f3ab-4aae-89ad-60b31cd88bcb tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:22.430029 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ff97dbe1-9270-41fd-99f8-c121af479647 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:22.440182 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ff97dbe1-9270-41fd-99f8-c121af479647 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:22.441621 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ff97dbe1-9270-41fd-99f8-c121af479647 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:22.443265 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ff97dbe1-9270-41fd-99f8-c121af479647 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1725 microversion: 2.20 time: 0.199239 Sep 01 16:38:22.443867 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 140/273] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:22 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1725 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:22.681503 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a13161cc-f3ab-4aae-89ad-60b31cd88bcb tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "POST /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.364014 Sep 01 16:38:22.682535 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 134/274] 10.222.0.62 () {60 vars in 1323 bytes} [Thu Sep 1 16:38:22 2022] POST /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037/os-volume_attachments => generated 194 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:38:22.803118 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-5ef9acbe-4f2d-499b-a5d4-f8ac690e64b6 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:22.803514 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-5ef9acbe-4f2d-499b-a5d4-f8ac690e64b6 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: b16ceffd-c9b2-49e6-a44d-7353a17f230a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:22.810412 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5ef9acbe-4f2d-499b-a5d4-f8ac690e64b6 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:22.810902 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5ef9acbe-4f2d-499b-a5d4-f8ac690e64b6 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:22.811336 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5ef9acbe-4f2d-499b-a5d4-f8ac690e64b6 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:22.812070 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5ef9acbe-4f2d-499b-a5d4-f8ac690e64b6 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:22.812502 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5ef9acbe-4f2d-499b-a5d4-f8ac690e64b6 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:22.813293 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5ef9acbe-4f2d-499b-a5d4-f8ac690e64b6 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:22.832633 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e6df419e-20d7-448c-8a9d-04f459297b97 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:22.833622 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e6df419e-20d7-448c-8a9d-04f459297b97 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] [instance: 757d4563-fb3e-49ce-b98b-f2b522d66845] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:22.840580 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e6df419e-20d7-448c-8a9d-04f459297b97 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:22.841121 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e6df419e-20d7-448c-8a9d-04f459297b97 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:22.841557 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-5ef9acbe-4f2d-499b-a5d4-f8ac690e64b6 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a/ips" status: 200 len: 150 microversion: 2.1 time: 0.042527 Sep 01 16:38:22.841667 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e6df419e-20d7-448c-8a9d-04f459297b97 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:22.842316 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 141/275] 10.222.0.62 () {58 vars in 1248 bytes} [Thu Sep 1 16:38:22 2022] GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:38:22.842446 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e6df419e-20d7-448c-8a9d-04f459297b97 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:22.842769 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e6df419e-20d7-448c-8a9d-04f459297b97 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:22.843288 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e6df419e-20d7-448c-8a9d-04f459297b97 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:23.012239 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e6df419e-20d7-448c-8a9d-04f459297b97 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535e932c54904b83bfc19fd68df95116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c33dc11d9d41eabd986b4a4c536616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:23.026154 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e6df419e-20d7-448c-8a9d-04f459297b97 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] 10.222.0.62 "GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845" status: 200 len: 1315 microversion: 2.1 time: 0.196786 Sep 01 16:38:23.027580 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 135/276] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:22 2022] GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:23.263576 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-dc133b8c-a82f-47a9-bd19-809532ae4333 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:23.264269 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-dc133b8c-a82f-47a9-bd19-809532ae4333 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:23.270830 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dc133b8c-a82f-47a9-bd19-809532ae4333 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:23.271319 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dc133b8c-a82f-47a9-bd19-809532ae4333 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:23.271752 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dc133b8c-a82f-47a9-bd19-809532ae4333 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:23.272487 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dc133b8c-a82f-47a9-bd19-809532ae4333 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:23.273047 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dc133b8c-a82f-47a9-bd19-809532ae4333 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:23.273448 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dc133b8c-a82f-47a9-bd19-809532ae4333 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:23.338832 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-4a835aaf-0f06-4937-9b8e-48ff87a8d4ba tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:23.339618 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-4a835aaf-0f06-4937-9b8e-48ff87a8d4ba tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:23.350098 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4a835aaf-0f06-4937-9b8e-48ff87a8d4ba tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:23.351287 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4a835aaf-0f06-4937-9b8e-48ff87a8d4ba tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:23.351849 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4a835aaf-0f06-4937-9b8e-48ff87a8d4ba tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:23.352879 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4a835aaf-0f06-4937-9b8e-48ff87a8d4ba tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:23.353927 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4a835aaf-0f06-4937-9b8e-48ff87a8d4ba tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:23.354400 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4a835aaf-0f06-4937-9b8e-48ff87a8d4ba tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:23.476299 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-dc133b8c-a82f-47a9-bd19-809532ae4333 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:23.485896 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-dc133b8c-a82f-47a9-bd19-809532ae4333 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648" status: 200 len: 1522 microversion: 2.1 time: 0.227025 Sep 01 16:38:23.486507 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 142/277] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:23 2022] GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:23.491439 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a874e1d8-43fa-4eb5-a643-f8e3c67e57fd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:23.492035 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-a874e1d8-43fa-4eb5-a643-f8e3c67e57fd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:23.498771 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a874e1d8-43fa-4eb5-a643-f8e3c67e57fd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:23.499448 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a874e1d8-43fa-4eb5-a643-f8e3c67e57fd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:23.500033 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a874e1d8-43fa-4eb5-a643-f8e3c67e57fd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:23.501124 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a874e1d8-43fa-4eb5-a643-f8e3c67e57fd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:23.501573 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a874e1d8-43fa-4eb5-a643-f8e3c67e57fd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:23.501984 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a874e1d8-43fa-4eb5-a643-f8e3c67e57fd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:23.563468 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-4a835aaf-0f06-4937-9b8e-48ff87a8d4ba tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:23.571525 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-4a835aaf-0f06-4937-9b8e-48ff87a8d4ba tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1259 microversion: 2.1 time: 0.238468 Sep 01 16:38:23.572141 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 136/278] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:23 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1259 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:23.658081 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-a874e1d8-43fa-4eb5-a643-f8e3c67e57fd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:23.673810 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-a874e1d8-43fa-4eb5-a643-f8e3c67e57fd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:23.675348 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-a874e1d8-43fa-4eb5-a643-f8e3c67e57fd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:23.676611 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-a874e1d8-43fa-4eb5-a643-f8e3c67e57fd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1725 microversion: 2.20 time: 0.188987 Sep 01 16:38:23.677192 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 143/279] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:23 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:24.047469 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-34cc5d6f-5bee-4bfb-b222-47b31635db31 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:24.048199 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-34cc5d6f-5bee-4bfb-b222-47b31635db31 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] [instance: 757d4563-fb3e-49ce-b98b-f2b522d66845] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:24.055144 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-34cc5d6f-5bee-4bfb-b222-47b31635db31 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:24.055643 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-34cc5d6f-5bee-4bfb-b222-47b31635db31 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:24.056123 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-34cc5d6f-5bee-4bfb-b222-47b31635db31 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:24.057106 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-34cc5d6f-5bee-4bfb-b222-47b31635db31 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:24.057690 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-34cc5d6f-5bee-4bfb-b222-47b31635db31 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:24.058132 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-34cc5d6f-5bee-4bfb-b222-47b31635db31 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:24.199354 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-34cc5d6f-5bee-4bfb-b222-47b31635db31 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535e932c54904b83bfc19fd68df95116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c33dc11d9d41eabd986b4a4c536616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:24.207779 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-34cc5d6f-5bee-4bfb-b222-47b31635db31 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] 10.222.0.62 "GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845" status: 200 len: 1315 microversion: 2.1 time: 0.164222 Sep 01 16:38:24.208393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 137/280] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:24 2022] GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:24.507254 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-f9bfce05-b6f7-4128-97b0-723db65ce9c4 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:24.507882 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-f9bfce05-b6f7-4128-97b0-723db65ce9c4 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:24.514437 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f9bfce05-b6f7-4128-97b0-723db65ce9c4 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:24.514941 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f9bfce05-b6f7-4128-97b0-723db65ce9c4 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:24.515380 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f9bfce05-b6f7-4128-97b0-723db65ce9c4 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:24.516116 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f9bfce05-b6f7-4128-97b0-723db65ce9c4 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:24.516611 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f9bfce05-b6f7-4128-97b0-723db65ce9c4 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:24.516950 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f9bfce05-b6f7-4128-97b0-723db65ce9c4 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:24.592464 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5b1ec1f4-9285-4eb1-9890-fe2dd9fb8153 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:24.593155 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5b1ec1f4-9285-4eb1-9890-fe2dd9fb8153 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:24.599304 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5b1ec1f4-9285-4eb1-9890-fe2dd9fb8153 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:24.599993 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5b1ec1f4-9285-4eb1-9890-fe2dd9fb8153 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:24.600574 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5b1ec1f4-9285-4eb1-9890-fe2dd9fb8153 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:24.601275 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5b1ec1f4-9285-4eb1-9890-fe2dd9fb8153 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:24.601724 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5b1ec1f4-9285-4eb1-9890-fe2dd9fb8153 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:24.602137 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5b1ec1f4-9285-4eb1-9890-fe2dd9fb8153 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:24.685780 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-f9bfce05-b6f7-4128-97b0-723db65ce9c4 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:24.695645 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-f9bfce05-b6f7-4128-97b0-723db65ce9c4 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648" status: 200 len: 1522 microversion: 2.1 time: 0.192074 Sep 01 16:38:24.696254 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 144/281] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:24 2022] GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:24.709504 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-612719eb-fd90-4840-9526-c63d89cf92bf tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:24.711122 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-612719eb-fd90-4840-9526-c63d89cf92bf tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:24.718593 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-612719eb-fd90-4840-9526-c63d89cf92bf tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:24.719207 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-612719eb-fd90-4840-9526-c63d89cf92bf tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:24.719639 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-612719eb-fd90-4840-9526-c63d89cf92bf tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:24.720387 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-612719eb-fd90-4840-9526-c63d89cf92bf tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:24.720814 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-612719eb-fd90-4840-9526-c63d89cf92bf tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:24.721251 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-612719eb-fd90-4840-9526-c63d89cf92bf tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:24.776077 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5b1ec1f4-9285-4eb1-9890-fe2dd9fb8153 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:24.784220 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5b1ec1f4-9285-4eb1-9890-fe2dd9fb8153 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1259 microversion: 2.1 time: 0.195562 Sep 01 16:38:24.784819 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 138/282] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:24 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1259 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:24.868855 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-612719eb-fd90-4840-9526-c63d89cf92bf tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:24.879668 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-612719eb-fd90-4840-9526-c63d89cf92bf tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:24.884944 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-612719eb-fd90-4840-9526-c63d89cf92bf tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:24.884944 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-612719eb-fd90-4840-9526-c63d89cf92bf tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1725 microversion: 2.20 time: 0.177989 Sep 01 16:38:24.884944 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 145/283] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:24 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:25.229083 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-12e4458a-846a-4057-9b9e-0ab1de30e962 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:25.229721 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-12e4458a-846a-4057-9b9e-0ab1de30e962 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] [instance: 757d4563-fb3e-49ce-b98b-f2b522d66845] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:25.236582 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-12e4458a-846a-4057-9b9e-0ab1de30e962 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:25.237062 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-12e4458a-846a-4057-9b9e-0ab1de30e962 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:25.237489 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-12e4458a-846a-4057-9b9e-0ab1de30e962 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:25.238219 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-12e4458a-846a-4057-9b9e-0ab1de30e962 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:25.238651 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-12e4458a-846a-4057-9b9e-0ab1de30e962 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:25.239079 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-12e4458a-846a-4057-9b9e-0ab1de30e962 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:25.241824 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:25.397402 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-12e4458a-846a-4057-9b9e-0ab1de30e962 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535e932c54904b83bfc19fd68df95116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c33dc11d9d41eabd986b4a4c536616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:25.406662 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-12e4458a-846a-4057-9b9e-0ab1de30e962 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] 10.222.0.62 "GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845" status: 200 len: 1315 microversion: 2.1 time: 0.181628 Sep 01 16:38:25.407202 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 139/284] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:25 2022] GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:25.724750 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-de63260c-c19d-462c-a018-4ccfa7f30a0e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:25.726047 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-de63260c-c19d-462c-a018-4ccfa7f30a0e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:25.737660 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-de63260c-c19d-462c-a018-4ccfa7f30a0e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:25.738645 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-de63260c-c19d-462c-a018-4ccfa7f30a0e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:25.739535 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-de63260c-c19d-462c-a018-4ccfa7f30a0e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:25.740958 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-de63260c-c19d-462c-a018-4ccfa7f30a0e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:25.741866 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-de63260c-c19d-462c-a018-4ccfa7f30a0e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:25.742723 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-de63260c-c19d-462c-a018-4ccfa7f30a0e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:25.806593 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e9a98ef7-3ce8-431d-89ba-6263be9582c5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:25.807506 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e9a98ef7-3ce8-431d-89ba-6263be9582c5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:25.815968 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e9a98ef7-3ce8-431d-89ba-6263be9582c5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:25.816695 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e9a98ef7-3ce8-431d-89ba-6263be9582c5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:25.817191 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e9a98ef7-3ce8-431d-89ba-6263be9582c5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:25.817928 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e9a98ef7-3ce8-431d-89ba-6263be9582c5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:25.818387 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e9a98ef7-3ce8-431d-89ba-6263be9582c5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:25.818784 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e9a98ef7-3ce8-431d-89ba-6263be9582c5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:25.973335 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-de63260c-c19d-462c-a018-4ccfa7f30a0e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:25.993329 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-de63260c-c19d-462c-a018-4ccfa7f30a0e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648" status: 200 len: 1522 microversion: 2.1 time: 0.276896 Sep 01 16:38:25.994465 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 146/285] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:25 2022] GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648 => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:26.000928 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-fcae98d2-ea38-4883-977e-411b7ee186c3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:26.001733 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-fcae98d2-ea38-4883-977e-411b7ee186c3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:26.008814 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fcae98d2-ea38-4883-977e-411b7ee186c3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:26.009519 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fcae98d2-ea38-4883-977e-411b7ee186c3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:26.010175 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fcae98d2-ea38-4883-977e-411b7ee186c3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:26.011246 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fcae98d2-ea38-4883-977e-411b7ee186c3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:26.011872 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fcae98d2-ea38-4883-977e-411b7ee186c3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:26.012559 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fcae98d2-ea38-4883-977e-411b7ee186c3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:26.014346 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e9a98ef7-3ce8-431d-89ba-6263be9582c5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:26.023295 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e9a98ef7-3ce8-431d-89ba-6263be9582c5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1259 microversion: 2.1 time: 0.221249 Sep 01 16:38:26.024288 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 140/286] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:25 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1259 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:26.175363 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-fcae98d2-ea38-4883-977e-411b7ee186c3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:26.186723 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-fcae98d2-ea38-4883-977e-411b7ee186c3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:26.188779 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-fcae98d2-ea38-4883-977e-411b7ee186c3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:26.189500 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-fcae98d2-ea38-4883-977e-411b7ee186c3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1725 microversion: 2.20 time: 0.193336 Sep 01 16:38:26.190053 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 147/287] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:25 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1725 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:26.407881 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a4e400f5-db33-429f-840b-f59b779b3d55 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "38e7f701-4a58-42b3-97e2-e6f8a921b80e"}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:26.410661 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a4e400f5-db33-429f-840b-f59b779b3d55 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: b16ceffd-c9b2-49e6-a44d-7353a17f230a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:26.418465 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a4e400f5-db33-429f-840b-f59b779b3d55 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:26.418465 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a4e400f5-db33-429f-840b-f59b779b3d55 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:26.418993 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a4e400f5-db33-429f-840b-f59b779b3d55 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:26.420258 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a4e400f5-db33-429f-840b-f59b779b3d55 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:26.420816 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a4e400f5-db33-429f-840b-f59b779b3d55 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:26.421374 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a4e400f5-db33-429f-840b-f59b779b3d55 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:26.435734 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-857e0e0e-590b-4ade-90ce-05be87fba790 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:26.436501 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-857e0e0e-590b-4ade-90ce-05be87fba790 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] [instance: 757d4563-fb3e-49ce-b98b-f2b522d66845] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:26.443503 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-857e0e0e-590b-4ade-90ce-05be87fba790 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:26.444143 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-857e0e0e-590b-4ade-90ce-05be87fba790 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:26.444824 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-857e0e0e-590b-4ade-90ce-05be87fba790 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:26.445592 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-857e0e0e-590b-4ade-90ce-05be87fba790 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:26.446245 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-857e0e0e-590b-4ade-90ce-05be87fba790 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:26.446779 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-857e0e0e-590b-4ade-90ce-05be87fba790 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:26.625069 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-857e0e0e-590b-4ade-90ce-05be87fba790 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535e932c54904b83bfc19fd68df95116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c33dc11d9d41eabd986b4a4c536616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:26.637120 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-857e0e0e-590b-4ade-90ce-05be87fba790 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] 10.222.0.62 "GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845" status: 200 len: 1315 microversion: 2.1 time: 0.206318 Sep 01 16:38:26.637726 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 148/288] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:26 2022] GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:27.016415 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-95a310ed-1b8e-4368-a722-c9a92522bc00 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:27.017239 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-95a310ed-1b8e-4368-a722-c9a92522bc00 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:27.023875 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-95a310ed-1b8e-4368-a722-c9a92522bc00 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:27.024364 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-95a310ed-1b8e-4368-a722-c9a92522bc00 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:27.024708 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-95a310ed-1b8e-4368-a722-c9a92522bc00 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:27.025504 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-95a310ed-1b8e-4368-a722-c9a92522bc00 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:27.026226 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-95a310ed-1b8e-4368-a722-c9a92522bc00 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:27.027000 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-95a310ed-1b8e-4368-a722-c9a92522bc00 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:27.167097 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-95a310ed-1b8e-4368-a722-c9a92522bc00 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:27.179612 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-95a310ed-1b8e-4368-a722-c9a92522bc00 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648" status: 200 len: 1502 microversion: 2.1 time: 0.167468 Sep 01 16:38:27.180297 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 149/289] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:27 2022] GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648 => generated 1502 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:27.186631 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-3f1213e0-d63d-4f7f-8908-19f068140ba6 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:27.187359 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-3f1213e0-d63d-4f7f-8908-19f068140ba6 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:27.193793 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3f1213e0-d63d-4f7f-8908-19f068140ba6 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:27.194312 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3f1213e0-d63d-4f7f-8908-19f068140ba6 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:27.194710 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3f1213e0-d63d-4f7f-8908-19f068140ba6 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:27.195426 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3f1213e0-d63d-4f7f-8908-19f068140ba6 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:27.195846 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3f1213e0-d63d-4f7f-8908-19f068140ba6 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:27.196325 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3f1213e0-d63d-4f7f-8908-19f068140ba6 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:27.343190 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-3f1213e0-d63d-4f7f-8908-19f068140ba6 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:27.355650 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-3f1213e0-d63d-4f7f-8908-19f068140ba6 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1259 microversion: 2.1 time: 0.174289 Sep 01 16:38:27.356239 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 150/290] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:27 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:27.361918 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-f4f53897-47fd-4026-8df1-b0361abc279b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4837c1ae-b8bb-438b-ae65-94a381bc32f2"}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:27.364377 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-f4f53897-47fd-4026-8df1-b0361abc279b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:27.370558 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f4f53897-47fd-4026-8df1-b0361abc279b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:27.371039 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f4f53897-47fd-4026-8df1-b0361abc279b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:27.371464 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f4f53897-47fd-4026-8df1-b0361abc279b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:27.372188 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f4f53897-47fd-4026-8df1-b0361abc279b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:27.372654 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f4f53897-47fd-4026-8df1-b0361abc279b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:27.373042 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f4f53897-47fd-4026-8df1-b0361abc279b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:27.393420 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=100 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:27.408511 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-f4f53897-47fd-4026-8df1-b0361abc279b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] HTTP exception thrown: Cannot 'attach_volume' instance 5537b019-c314-4b22-bde4-b19b3641c648 while it is in vm_state rescued Sep 01 16:38:27.411027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-f4f53897-47fd-4026-8df1-b0361abc279b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Request method failure captured: Sep 01 16:38:27.411027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: request: POST /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648/os-volume_attachments HTTP/1.1 Sep 01 16:38:27.411027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 01 16:38:27.411027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 01 16:38:27.411027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Connection: close Sep 01 16:38:27.411027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Length: 74 Sep 01 16:38:27.411027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 01 16:38:27.411027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Host: 10.222.0.62 Sep 01 16:38:27.411027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 01 16:38:27.411027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 01 16:38:27.411027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjEN-Hts0Mr9WeZLVVha0OUabTAqWGElr--EmdAiOOM-cApKNFGz-VYPGEBh-XtHr4mngp8wOv7uR2S1_H1kjugmtEeioWaKFgQasL22TUHp0ruIbb4qLL0bIAqzf73Vb_OIQurxRZ_z3v0E35M_p2nrgRTWzIx_SloZcsKtKtINXJHVs Sep 01 16:38:27.411027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 01 16:38:27.411027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 01 16:38:27.411027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 01 16:38:27.411027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 01 16:38:27.411027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 01 16:38:27.411027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 01 16:38:27.411027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Id: 601c248b5d9b48488351cb4d9561a2f4 Sep 01 16:38:27.411027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-120173524 Sep 01 16:38:27.411027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 01 16:38:27.411027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 01 16:38:27.412481 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/601c248b5d9b48488351cb4d9561a2f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/601c248b5d9b48488351cb4d9561a2f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_601c248b5d9b48488351cb4d9561a2f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/601c248b5d9b48488351cb4d9561a2f4"}]}] Sep 01 16:38:27.412481 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-ServerRescueNegativeTestJSON-120173524 Sep 01 16:38:27.412481 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Id: 601c248b5d9b48488351cb4d9561a2f4 Sep 01 16:38:27.412481 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-120173524 Sep 01 16:38:27.412481 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User: tempest-ServerRescueNegativeTestJSON-120173524-project Sep 01 16:38:27.412481 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 01 16:38:27.412481 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 01 16:38:27.412481 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Id: 52760b6736e14ccd8df8aca0015cb292 Sep 01 16:38:27.412481 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-ServerRescueNegativeTestJSON-120173524-project Sep 01 16:38:27.412481 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Sep 01 16:38:27.412481 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: {"volumeAttachment": {"volumeId": "4837c1ae-b8bb-438b-ae65-94a381bc32f2"}} Sep 01 16:38:27.412481 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: method: > Sep 01 16:38:27.413300 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: exception: Cannot 'attach_volume' instance 5537b019-c314-4b22-bde4-b19b3641c648 while it is in vm_state rescued Sep 01 16:38:27.413300 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: action_args: {'server_id': '5537b019-c314-4b22-bde4-b19b3641c648', 'body': {'volumeAttachment': {'volumeId': '4837c1ae-b8bb-438b-ae65-94a381bc32f2'}}} Sep 01 16:38:27.413300 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:38:27.413300 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:38:27.413300 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 16:38:27.413300 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 16:38:27.413300 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 16:38:27.413300 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 16:38:27.413300 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 16:38:27.413300 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 16:38:27.413300 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5537b019-c314-4b22-bde4-b19b3641c648 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 01 16:38:27.413300 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:38:27.413300 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:38:27.413300 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:38:27.413300 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:38:27.413300 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:38:27.413300 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:38:27.413300 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:38:27.413300 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:38:27.414393 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:38:27.414393 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:38:27.414393 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 16:38:27.414393 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 16:38:27.414393 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 16:38:27.414393 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 16:38:27.414393 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 16:38:27.414393 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 16:38:27.414393 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 01 16:38:27.414393 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 16:38:27.414393 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 16:38:27.414393 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 16:38:27.414393 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 5537b019-c314-4b22-bde4-b19b3641c648 while it is in vm_state rescued Sep 01 16:38:27.414393 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:38:27.414393 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:38:27.414393 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:38:27.414393 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:38:27.414393 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:38:27.414393 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:38:27.415478 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:38:27.415478 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:38:27.415478 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 5537b019-c314-4b22-bde4-b19b3641c648 while it is in vm_state rescued Sep 01 16:38:27.415478 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:38:27.415478 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-f4f53897-47fd-4026-8df1-b0361abc279b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Returning 409 to user: Cannot 'attach_volume' instance 5537b019-c314-4b22-bde4-b19b3641c648 while it is in vm_state rescued {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:38:27.415478 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-f4f53897-47fd-4026-8df1-b0361abc279b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "POST /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.054598 Sep 01 16:38:27.415478 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 151/291] 10.222.0.62 () {60 vars in 1323 bytes} [Thu Sep 1 16:38:27 2022] POST /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648/os-volume_attachments => generated 152 bytes in 56 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 01 16:38:27.418370 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-45857fdc-2c62-470d-a989-7506a654dc99 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:27.418971 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-45857fdc-2c62-470d-a989-7506a654dc99 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:27.425353 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-45857fdc-2c62-470d-a989-7506a654dc99 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:27.425842 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-45857fdc-2c62-470d-a989-7506a654dc99 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:27.426269 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-45857fdc-2c62-470d-a989-7506a654dc99 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:27.426954 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-45857fdc-2c62-470d-a989-7506a654dc99 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:27.427405 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-45857fdc-2c62-470d-a989-7506a654dc99 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:27.427817 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-45857fdc-2c62-470d-a989-7506a654dc99 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:27.565499 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-45857fdc-2c62-470d-a989-7506a654dc99 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:27.574059 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-45857fdc-2c62-470d-a989-7506a654dc99 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:27.575479 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-45857fdc-2c62-470d-a989-7506a654dc99 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:27.576709 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-45857fdc-2c62-470d-a989-7506a654dc99 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1725 microversion: 2.20 time: 0.162724 Sep 01 16:38:27.577604 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 152/292] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:27 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:27.582229 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-5e65b60f-46d6-4ce8-8728-0a47e9c66824 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:27.582752 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-5e65b60f-46d6-4ce8-8728-0a47e9c66824 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:27.589597 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5e65b60f-46d6-4ce8-8728-0a47e9c66824 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:27.590067 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5e65b60f-46d6-4ce8-8728-0a47e9c66824 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:27.590501 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5e65b60f-46d6-4ce8-8728-0a47e9c66824 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:27.591199 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5e65b60f-46d6-4ce8-8728-0a47e9c66824 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:27.591652 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5e65b60f-46d6-4ce8-8728-0a47e9c66824 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:27.592113 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5e65b60f-46d6-4ce8-8728-0a47e9c66824 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:27.666207 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-5e65b60f-46d6-4ce8-8728-0a47e9c66824 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "POST /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648/action" status: 202 len: 0 microversion: 2.1 time: 0.087392 Sep 01 16:38:27.666881 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 153/293] 10.222.0.62 () {60 vars in 1278 bytes} [Thu Sep 1 16:38:27 2022] POST /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:38:27.671832 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d7dfba9e-7c01-4fe7-b274-6337667b2ef8 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:27.672547 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d7dfba9e-7c01-4fe7-b274-6337667b2ef8 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] [instance: 757d4563-fb3e-49ce-b98b-f2b522d66845] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:27.678518 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d7dfba9e-7c01-4fe7-b274-6337667b2ef8 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:27.678997 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d7dfba9e-7c01-4fe7-b274-6337667b2ef8 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:27.679425 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d7dfba9e-7c01-4fe7-b274-6337667b2ef8 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:27.680136 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d7dfba9e-7c01-4fe7-b274-6337667b2ef8 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:27.680594 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d7dfba9e-7c01-4fe7-b274-6337667b2ef8 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:27.681012 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d7dfba9e-7c01-4fe7-b274-6337667b2ef8 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:27.825454 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d7dfba9e-7c01-4fe7-b274-6337667b2ef8 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535e932c54904b83bfc19fd68df95116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c33dc11d9d41eabd986b4a4c536616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:27.837442 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d7dfba9e-7c01-4fe7-b274-6337667b2ef8 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] 10.222.0.62 "GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845" status: 200 len: 1315 microversion: 2.1 time: 0.169152 Sep 01 16:38:27.838209 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 154/294] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:27 2022] GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:27.842818 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-23fcdaee-fca5-44db-854e-9fb2a6758704 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:27.843402 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-23fcdaee-fca5-44db-854e-9fb2a6758704 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:27.849112 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-23fcdaee-fca5-44db-854e-9fb2a6758704 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:27.849618 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-23fcdaee-fca5-44db-854e-9fb2a6758704 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:27.850035 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-23fcdaee-fca5-44db-854e-9fb2a6758704 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:27.850708 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-23fcdaee-fca5-44db-854e-9fb2a6758704 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:27.851150 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-23fcdaee-fca5-44db-854e-9fb2a6758704 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:27.851552 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-23fcdaee-fca5-44db-854e-9fb2a6758704 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:27.990516 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-23fcdaee-fca5-44db-854e-9fb2a6758704 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:27.998590 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-23fcdaee-fca5-44db-854e-9fb2a6758704 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648" status: 200 len: 1510 microversion: 2.1 time: 0.159365 Sep 01 16:38:27.999159 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 155/295] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:27 2022] GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:28.378159 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-6a3e1c6b-672b-497b-994a-026ebe51e416 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:28.378816 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-6a3e1c6b-672b-497b-994a-026ebe51e416 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:28.384905 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6a3e1c6b-672b-497b-994a-026ebe51e416 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:28.385381 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6a3e1c6b-672b-497b-994a-026ebe51e416 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:28.385800 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6a3e1c6b-672b-497b-994a-026ebe51e416 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:28.386474 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6a3e1c6b-672b-497b-994a-026ebe51e416 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:28.386890 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6a3e1c6b-672b-497b-994a-026ebe51e416 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:28.387472 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6a3e1c6b-672b-497b-994a-026ebe51e416 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:28.674626 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-6a3e1c6b-672b-497b-994a-026ebe51e416 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:28.682454 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-6a3e1c6b-672b-497b-994a-026ebe51e416 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1259 microversion: 2.1 time: 0.308286 Sep 01 16:38:28.683152 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 156/296] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:28 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1259 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:28.688133 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-763ba131-97b0-4fc4-9bfc-d09f9d9c67c7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:28.688727 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-763ba131-97b0-4fc4-9bfc-d09f9d9c67c7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:28.695373 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-763ba131-97b0-4fc4-9bfc-d09f9d9c67c7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:28.695988 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-763ba131-97b0-4fc4-9bfc-d09f9d9c67c7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:28.696312 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-763ba131-97b0-4fc4-9bfc-d09f9d9c67c7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:28.697001 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-763ba131-97b0-4fc4-9bfc-d09f9d9c67c7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:28.697444 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-763ba131-97b0-4fc4-9bfc-d09f9d9c67c7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:28.697859 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-763ba131-97b0-4fc4-9bfc-d09f9d9c67c7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:28.839217 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-763ba131-97b0-4fc4-9bfc-d09f9d9c67c7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:28.848847 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-763ba131-97b0-4fc4-9bfc-d09f9d9c67c7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:28.850325 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-763ba131-97b0-4fc4-9bfc-d09f9d9c67c7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:28.851501 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-763ba131-97b0-4fc4-9bfc-d09f9d9c67c7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1725 microversion: 2.20 time: 0.167238 Sep 01 16:38:28.852054 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 157/297] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:28 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:28.859047 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ebb20eea-e5e6-4341-9e05-315b35ad4ac9 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:28.859647 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ebb20eea-e5e6-4341-9e05-315b35ad4ac9 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] [instance: 757d4563-fb3e-49ce-b98b-f2b522d66845] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:28.865941 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ebb20eea-e5e6-4341-9e05-315b35ad4ac9 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:28.866432 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ebb20eea-e5e6-4341-9e05-315b35ad4ac9 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:28.866861 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ebb20eea-e5e6-4341-9e05-315b35ad4ac9 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:28.867537 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ebb20eea-e5e6-4341-9e05-315b35ad4ac9 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:28.868040 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ebb20eea-e5e6-4341-9e05-315b35ad4ac9 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:28.868462 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ebb20eea-e5e6-4341-9e05-315b35ad4ac9 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:29.008143 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ebb20eea-e5e6-4341-9e05-315b35ad4ac9 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535e932c54904b83bfc19fd68df95116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c33dc11d9d41eabd986b4a4c536616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:29.018600 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ebb20eea-e5e6-4341-9e05-315b35ad4ac9 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] 10.222.0.62 "GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845" status: 200 len: 1315 microversion: 2.1 time: 0.162966 Sep 01 16:38:29.019291 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 158/298] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:28 2022] GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:29.023694 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-488c52c0-11e2-4ac2-ae99-0f755342c2f2 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:29.024498 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-488c52c0-11e2-4ac2-ae99-0f755342c2f2 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:29.032054 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-488c52c0-11e2-4ac2-ae99-0f755342c2f2 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:29.032548 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-488c52c0-11e2-4ac2-ae99-0f755342c2f2 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:29.032979 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-488c52c0-11e2-4ac2-ae99-0f755342c2f2 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:29.033667 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-488c52c0-11e2-4ac2-ae99-0f755342c2f2 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:29.034118 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-488c52c0-11e2-4ac2-ae99-0f755342c2f2 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:29.034539 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-488c52c0-11e2-4ac2-ae99-0f755342c2f2 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:29.172661 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-488c52c0-11e2-4ac2-ae99-0f755342c2f2 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:29.181367 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-488c52c0-11e2-4ac2-ae99-0f755342c2f2 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648" status: 200 len: 1510 microversion: 2.1 time: 0.161092 Sep 01 16:38:29.181955 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 159/299] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:29 2022] GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648 => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:29.428482 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a4e400f5-db33-429f-840b-f59b779b3d55 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "POST /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.025288 Sep 01 16:38:29.429432 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 141/300] 10.222.0.62 () {60 vars in 1323 bytes} [Thu Sep 1 16:38:26 2022] POST /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a/os-volume_attachments => generated 194 bytes in 3027 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:38:29.441975 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-04fd3c91-09d5-47c2-b404-8d8bdd0cf421 req-ace2381d-f89c-4e87-ad27-565dd76d955a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "757d4563-fb3e-49ce-b98b-f2b522d66845", "name": "network-vif-plugged", "status": "completed", "tag": "4500feb8-e551-4e82-bfe1-08ba5a216dd6"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:29.454193 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-04fd3c91-09d5-47c2-b404-8d8bdd0cf421 req-ace2381d-f89c-4e87-ad27-565dd76d955a service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:29.454763 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-04fd3c91-09d5-47c2-b404-8d8bdd0cf421 req-ace2381d-f89c-4e87-ad27-565dd76d955a service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:29.455601 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-04fd3c91-09d5-47c2-b404-8d8bdd0cf421 req-ace2381d-f89c-4e87-ad27-565dd76d955a service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:29.467136 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-04fd3c91-09d5-47c2-b404-8d8bdd0cf421 req-ace2381d-f89c-4e87-ad27-565dd76d955a service nova] Creating event network-vif-plugged:4500feb8-e551-4e82-bfe1-08ba5a216dd6 for instance 757d4563-fb3e-49ce-b98b-f2b522d66845 on hv-cinder-85221 Sep 01 16:38:29.473056 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-04fd3c91-09d5-47c2-b404-8d8bdd0cf421 req-ace2381d-f89c-4e87-ad27-565dd76d955a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034316 Sep 01 16:38:29.474874 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 160/301] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:38:29.714169 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1fd4a4f1-069e-4e58-9f30-4e539c5c7eb5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:29.715630 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1fd4a4f1-069e-4e58-9f30-4e539c5c7eb5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:29.722565 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1fd4a4f1-069e-4e58-9f30-4e539c5c7eb5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:29.723048 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1fd4a4f1-069e-4e58-9f30-4e539c5c7eb5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:29.723481 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1fd4a4f1-069e-4e58-9f30-4e539c5c7eb5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:29.724203 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1fd4a4f1-069e-4e58-9f30-4e539c5c7eb5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:29.724656 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1fd4a4f1-069e-4e58-9f30-4e539c5c7eb5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:29.725077 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1fd4a4f1-069e-4e58-9f30-4e539c5c7eb5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:29.872185 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1fd4a4f1-069e-4e58-9f30-4e539c5c7eb5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:29.875928 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-fcd7fe6d-e398-4104-a72b-225890c2a5f1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:29.876092 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-fcd7fe6d-e398-4104-a72b-225890c2a5f1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:29.880502 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1fd4a4f1-069e-4e58-9f30-4e539c5c7eb5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1259 microversion: 2.1 time: 0.178796 Sep 01 16:38:29.881030 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 142/302] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:29 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:29.882595 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fcd7fe6d-e398-4104-a72b-225890c2a5f1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:29.883168 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fcd7fe6d-e398-4104-a72b-225890c2a5f1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:29.883656 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fcd7fe6d-e398-4104-a72b-225890c2a5f1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:29.884614 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fcd7fe6d-e398-4104-a72b-225890c2a5f1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:29.885132 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fcd7fe6d-e398-4104-a72b-225890c2a5f1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:29.885632 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fcd7fe6d-e398-4104-a72b-225890c2a5f1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:30.026361 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-fcd7fe6d-e398-4104-a72b-225890c2a5f1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:30.036569 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-fcd7fe6d-e398-4104-a72b-225890c2a5f1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:30.038008 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-fcd7fe6d-e398-4104-a72b-225890c2a5f1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:30.039177 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-fcd7fe6d-e398-4104-a72b-225890c2a5f1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1725 microversion: 2.20 time: 0.168136 Sep 01 16:38:30.039725 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 161/303] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:29 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:30.041528 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-70748368-9a43-4712-a48b-940bc1bdd559 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:30.042157 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-70748368-9a43-4712-a48b-940bc1bdd559 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] [instance: 757d4563-fb3e-49ce-b98b-f2b522d66845] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:30.049168 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-70748368-9a43-4712-a48b-940bc1bdd559 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:30.049649 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-70748368-9a43-4712-a48b-940bc1bdd559 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:30.050085 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-70748368-9a43-4712-a48b-940bc1bdd559 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:30.050769 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-70748368-9a43-4712-a48b-940bc1bdd559 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:30.051219 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-70748368-9a43-4712-a48b-940bc1bdd559 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:30.051639 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-70748368-9a43-4712-a48b-940bc1bdd559 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:30.191718 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-70748368-9a43-4712-a48b-940bc1bdd559 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535e932c54904b83bfc19fd68df95116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c33dc11d9d41eabd986b4a4c536616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:30.200288 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-70748368-9a43-4712-a48b-940bc1bdd559 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] 10.222.0.62 "GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845" status: 200 len: 1315 microversion: 2.1 time: 0.162534 Sep 01 16:38:30.204235 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-41ef2d00-2862-426b-8f56-8db7fb350cc9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:30.204874 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-41ef2d00-2862-426b-8f56-8db7fb350cc9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:30.211095 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-41ef2d00-2862-426b-8f56-8db7fb350cc9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:30.211621 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-41ef2d00-2862-426b-8f56-8db7fb350cc9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:30.212121 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-41ef2d00-2862-426b-8f56-8db7fb350cc9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:30.212906 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-41ef2d00-2862-426b-8f56-8db7fb350cc9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:30.213336 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 143/304] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:30 2022] GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:30.213449 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-41ef2d00-2862-426b-8f56-8db7fb350cc9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:30.213758 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-41ef2d00-2862-426b-8f56-8db7fb350cc9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:30.351814 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-41ef2d00-2862-426b-8f56-8db7fb350cc9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:30.360513 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-41ef2d00-2862-426b-8f56-8db7fb350cc9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648" status: 200 len: 1510 microversion: 2.1 time: 0.161202 Sep 01 16:38:30.361077 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 162/305] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:30 2022] GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:30.905859 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f4d5147d-8e4d-4254-87c1-470f1e8e849f tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:30.907040 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f4d5147d-8e4d-4254-87c1-470f1e8e849f tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:30.917364 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f4d5147d-8e4d-4254-87c1-470f1e8e849f tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:30.918106 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f4d5147d-8e4d-4254-87c1-470f1e8e849f tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:30.918777 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f4d5147d-8e4d-4254-87c1-470f1e8e849f tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:30.920013 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f4d5147d-8e4d-4254-87c1-470f1e8e849f tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:30.920873 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f4d5147d-8e4d-4254-87c1-470f1e8e849f tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:30.921296 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f4d5147d-8e4d-4254-87c1-470f1e8e849f tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:31.062186 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-aee26d13-7bf4-4bf0-b42b-37138a8fede0 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:31.062785 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-aee26d13-7bf4-4bf0-b42b-37138a8fede0 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:31.067396 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f4d5147d-8e4d-4254-87c1-470f1e8e849f tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:31.069041 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aee26d13-7bf4-4bf0-b42b-37138a8fede0 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:31.069498 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aee26d13-7bf4-4bf0-b42b-37138a8fede0 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:31.069924 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aee26d13-7bf4-4bf0-b42b-37138a8fede0 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:31.070872 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aee26d13-7bf4-4bf0-b42b-37138a8fede0 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:31.071322 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aee26d13-7bf4-4bf0-b42b-37138a8fede0 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:31.071743 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aee26d13-7bf4-4bf0-b42b-37138a8fede0 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:31.075419 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f4d5147d-8e4d-4254-87c1-470f1e8e849f tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1259 microversion: 2.1 time: 0.176345 Sep 01 16:38:31.076076 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 144/306] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:30 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:31.206551 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-aee26d13-7bf4-4bf0-b42b-37138a8fede0 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:31.215012 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-aee26d13-7bf4-4bf0-b42b-37138a8fede0 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:31.216475 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-aee26d13-7bf4-4bf0-b42b-37138a8fede0 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:31.218375 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-aee26d13-7bf4-4bf0-b42b-37138a8fede0 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1725 microversion: 2.20 time: 0.160610 Sep 01 16:38:31.219379 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 163/307] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:31 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:31.222728 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c7449bc5-4039-4f25-ba00-0ec481db7751 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:31.223651 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c7449bc5-4039-4f25-ba00-0ec481db7751 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] [instance: 757d4563-fb3e-49ce-b98b-f2b522d66845] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:31.229981 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c7449bc5-4039-4f25-ba00-0ec481db7751 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:31.230467 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c7449bc5-4039-4f25-ba00-0ec481db7751 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:31.230897 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c7449bc5-4039-4f25-ba00-0ec481db7751 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:31.231593 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c7449bc5-4039-4f25-ba00-0ec481db7751 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:31.232082 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c7449bc5-4039-4f25-ba00-0ec481db7751 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:31.232583 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c7449bc5-4039-4f25-ba00-0ec481db7751 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:31.370948 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c7449bc5-4039-4f25-ba00-0ec481db7751 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535e932c54904b83bfc19fd68df95116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c33dc11d9d41eabd986b4a4c536616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:31.379190 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c7449bc5-4039-4f25-ba00-0ec481db7751 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] 10.222.0.62 "GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845" status: 200 len: 1315 microversion: 2.1 time: 0.160673 Sep 01 16:38:31.379757 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 145/308] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:31 2022] GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:31.382464 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-47759f2e-e182-41b1-8002-0f5a059f5a98 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:31.383082 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-47759f2e-e182-41b1-8002-0f5a059f5a98 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:31.389358 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-47759f2e-e182-41b1-8002-0f5a059f5a98 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:31.389831 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-47759f2e-e182-41b1-8002-0f5a059f5a98 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:31.390253 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-47759f2e-e182-41b1-8002-0f5a059f5a98 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:31.390939 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-47759f2e-e182-41b1-8002-0f5a059f5a98 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:31.391394 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-47759f2e-e182-41b1-8002-0f5a059f5a98 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:31.391806 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-47759f2e-e182-41b1-8002-0f5a059f5a98 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:31.531437 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-47759f2e-e182-41b1-8002-0f5a059f5a98 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:31.540585 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-47759f2e-e182-41b1-8002-0f5a059f5a98 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648" status: 200 len: 1510 microversion: 2.1 time: 0.161813 Sep 01 16:38:31.541241 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 164/309] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:31 2022] GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:32.097523 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-642d4146-1b58-41c6-abc3-f0387ac658b7 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:32.098495 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-642d4146-1b58-41c6-abc3-f0387ac658b7 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:32.106048 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-642d4146-1b58-41c6-abc3-f0387ac658b7 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:32.106537 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-642d4146-1b58-41c6-abc3-f0387ac658b7 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:32.106970 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-642d4146-1b58-41c6-abc3-f0387ac658b7 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:32.108075 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-642d4146-1b58-41c6-abc3-f0387ac658b7 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:32.108641 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-642d4146-1b58-41c6-abc3-f0387ac658b7 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:32.109097 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-642d4146-1b58-41c6-abc3-f0387ac658b7 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:32.243578 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-f7dd7835-1103-4433-b4d1-a7f181da2150 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:32.244193 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-f7dd7835-1103-4433-b4d1-a7f181da2150 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:32.251050 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f7dd7835-1103-4433-b4d1-a7f181da2150 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:32.251544 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f7dd7835-1103-4433-b4d1-a7f181da2150 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:32.252003 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f7dd7835-1103-4433-b4d1-a7f181da2150 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:32.252725 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f7dd7835-1103-4433-b4d1-a7f181da2150 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:32.253184 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f7dd7835-1103-4433-b4d1-a7f181da2150 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:32.253609 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f7dd7835-1103-4433-b4d1-a7f181da2150 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:32.261733 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-642d4146-1b58-41c6-abc3-f0387ac658b7 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:32.271348 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-642d4146-1b58-41c6-abc3-f0387ac658b7 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1259 microversion: 2.1 time: 0.178270 Sep 01 16:38:32.272100 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 146/310] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:32 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1259 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:32.393365 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-f7dd7835-1103-4433-b4d1-a7f181da2150 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:32.399659 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b31fa87d-54e1-432a-bb8c-3711f17fd29e tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:32.400322 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b31fa87d-54e1-432a-bb8c-3711f17fd29e tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] [instance: 757d4563-fb3e-49ce-b98b-f2b522d66845] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:32.402962 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-f7dd7835-1103-4433-b4d1-a7f181da2150 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:32.404608 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-f7dd7835-1103-4433-b4d1-a7f181da2150 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:32.406183 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-f7dd7835-1103-4433-b4d1-a7f181da2150 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1725 microversion: 2.20 time: 0.166626 Sep 01 16:38:32.406813 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 165/311] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:32 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:32.406923 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b31fa87d-54e1-432a-bb8c-3711f17fd29e tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:32.407416 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b31fa87d-54e1-432a-bb8c-3711f17fd29e tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:32.408021 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b31fa87d-54e1-432a-bb8c-3711f17fd29e tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:32.408740 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b31fa87d-54e1-432a-bb8c-3711f17fd29e tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:32.409221 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b31fa87d-54e1-432a-bb8c-3711f17fd29e tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:32.409851 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b31fa87d-54e1-432a-bb8c-3711f17fd29e tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:32.568228 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-54bfc1ab-2ef3-420e-8921-59e46aac9a7d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:32.568539 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-54bfc1ab-2ef3-420e-8921-59e46aac9a7d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:32.575856 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-54bfc1ab-2ef3-420e-8921-59e46aac9a7d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:32.576746 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-54bfc1ab-2ef3-420e-8921-59e46aac9a7d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:32.577534 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-54bfc1ab-2ef3-420e-8921-59e46aac9a7d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:32.578251 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-54bfc1ab-2ef3-420e-8921-59e46aac9a7d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:32.578701 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-54bfc1ab-2ef3-420e-8921-59e46aac9a7d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:32.579119 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-54bfc1ab-2ef3-420e-8921-59e46aac9a7d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:32.638682 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b31fa87d-54e1-432a-bb8c-3711f17fd29e tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535e932c54904b83bfc19fd68df95116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c33dc11d9d41eabd986b4a4c536616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:32.647280 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b31fa87d-54e1-432a-bb8c-3711f17fd29e tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] 10.222.0.62 "GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845" status: 200 len: 1315 microversion: 2.1 time: 0.251465 Sep 01 16:38:32.648126 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 147/312] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:32 2022] GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:32.733871 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-54bfc1ab-2ef3-420e-8921-59e46aac9a7d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:32.742136 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-54bfc1ab-2ef3-420e-8921-59e46aac9a7d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648" status: 200 len: 1510 microversion: 2.1 time: 0.182268 Sep 01 16:38:32.742734 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 166/313] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:32 2022] GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648 => generated 1510 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:33.296248 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-510c051a-71ea-46cd-b6fc-533af2ace558 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:33.297435 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-510c051a-71ea-46cd-b6fc-533af2ace558 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:33.306545 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-510c051a-71ea-46cd-b6fc-533af2ace558 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:33.307020 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-510c051a-71ea-46cd-b6fc-533af2ace558 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:33.307450 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-510c051a-71ea-46cd-b6fc-533af2ace558 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:33.308157 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-510c051a-71ea-46cd-b6fc-533af2ace558 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:33.308604 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-510c051a-71ea-46cd-b6fc-533af2ace558 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:33.309018 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-510c051a-71ea-46cd-b6fc-533af2ace558 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:33.431125 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d59ceda3-1ee2-4037-b1c0-7231e8d34914 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:33.431981 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d59ceda3-1ee2-4037-b1c0-7231e8d34914 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:33.434325 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:33.441298 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d59ceda3-1ee2-4037-b1c0-7231e8d34914 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:33.442036 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d59ceda3-1ee2-4037-b1c0-7231e8d34914 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:33.442652 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d59ceda3-1ee2-4037-b1c0-7231e8d34914 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:33.443450 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d59ceda3-1ee2-4037-b1c0-7231e8d34914 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:33.443968 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d59ceda3-1ee2-4037-b1c0-7231e8d34914 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:33.444400 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d59ceda3-1ee2-4037-b1c0-7231e8d34914 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:33.474280 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-510c051a-71ea-46cd-b6fc-533af2ace558 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:33.482220 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-510c051a-71ea-46cd-b6fc-533af2ace558 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1259 microversion: 2.1 time: 0.193108 Sep 01 16:38:33.482877 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 148/314] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:33 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1259 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:33.603204 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d59ceda3-1ee2-4037-b1c0-7231e8d34914 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:33.613203 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d59ceda3-1ee2-4037-b1c0-7231e8d34914 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:33.614940 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d59ceda3-1ee2-4037-b1c0-7231e8d34914 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:33.616170 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d59ceda3-1ee2-4037-b1c0-7231e8d34914 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1725 microversion: 2.20 time: 0.189227 Sep 01 16:38:33.617020 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 167/315] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:33 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1725 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:38:33.670776 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e3e29ae4-abb2-4712-8a10-bb954a571d2f tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:33.671367 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e3e29ae4-abb2-4712-8a10-bb954a571d2f tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] [instance: 757d4563-fb3e-49ce-b98b-f2b522d66845] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:33.678820 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e3e29ae4-abb2-4712-8a10-bb954a571d2f tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:33.679312 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e3e29ae4-abb2-4712-8a10-bb954a571d2f tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:33.679750 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e3e29ae4-abb2-4712-8a10-bb954a571d2f tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:33.680481 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e3e29ae4-abb2-4712-8a10-bb954a571d2f tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:33.680948 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e3e29ae4-abb2-4712-8a10-bb954a571d2f tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:33.681351 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e3e29ae4-abb2-4712-8a10-bb954a571d2f tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:33.770525 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-38840010-a098-4e48-b9ea-7e46f6beecea tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:33.771186 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-38840010-a098-4e48-b9ea-7e46f6beecea tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:33.777367 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-38840010-a098-4e48-b9ea-7e46f6beecea tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:33.777839 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-38840010-a098-4e48-b9ea-7e46f6beecea tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:33.778276 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-38840010-a098-4e48-b9ea-7e46f6beecea tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:33.778957 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-38840010-a098-4e48-b9ea-7e46f6beecea tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:33.779591 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-38840010-a098-4e48-b9ea-7e46f6beecea tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:33.780128 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-38840010-a098-4e48-b9ea-7e46f6beecea tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:33.783260 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:33.838340 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e3e29ae4-abb2-4712-8a10-bb954a571d2f tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535e932c54904b83bfc19fd68df95116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c33dc11d9d41eabd986b4a4c536616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:33.846616 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e3e29ae4-abb2-4712-8a10-bb954a571d2f tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] 10.222.0.62 "GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845" status: 200 len: 1315 microversion: 2.1 time: 0.180188 Sep 01 16:38:33.847175 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 149/316] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:33 2022] GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:33.923586 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-38840010-a098-4e48-b9ea-7e46f6beecea tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:33.931541 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-38840010-a098-4e48-b9ea-7e46f6beecea tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648" status: 200 len: 1510 microversion: 2.1 time: 0.165913 Sep 01 16:38:33.932182 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 168/317] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:33 2022] GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648 => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:34.503693 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6b0272cf-1da7-4461-9847-5956983f426b tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:34.504315 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-6b0272cf-1da7-4461-9847-5956983f426b tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:34.511578 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6b0272cf-1da7-4461-9847-5956983f426b tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:34.512101 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6b0272cf-1da7-4461-9847-5956983f426b tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:34.512537 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6b0272cf-1da7-4461-9847-5956983f426b tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:34.513501 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6b0272cf-1da7-4461-9847-5956983f426b tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:34.514072 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6b0272cf-1da7-4461-9847-5956983f426b tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:34.514540 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6b0272cf-1da7-4461-9847-5956983f426b tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:34.639596 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0fcea09f-96a1-454c-9522-28a9ecb87233 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:34.640308 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-0fcea09f-96a1-454c-9522-28a9ecb87233 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:34.647126 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0fcea09f-96a1-454c-9522-28a9ecb87233 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:34.647676 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0fcea09f-96a1-454c-9522-28a9ecb87233 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:34.648199 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0fcea09f-96a1-454c-9522-28a9ecb87233 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:34.654114 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0fcea09f-96a1-454c-9522-28a9ecb87233 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:34.654114 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0fcea09f-96a1-454c-9522-28a9ecb87233 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:34.654114 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0fcea09f-96a1-454c-9522-28a9ecb87233 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:34.667410 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-6b0272cf-1da7-4461-9847-5956983f426b tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:34.675556 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-6b0272cf-1da7-4461-9847-5956983f426b tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1259 microversion: 2.1 time: 0.175729 Sep 01 16:38:34.676278 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 150/318] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:34 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:34.788700 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-0fcea09f-96a1-454c-9522-28a9ecb87233 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:34.801097 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-0fcea09f-96a1-454c-9522-28a9ecb87233 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:34.802882 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-0fcea09f-96a1-454c-9522-28a9ecb87233 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:34.804077 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-0fcea09f-96a1-454c-9522-28a9ecb87233 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1725 microversion: 2.20 time: 0.168402 Sep 01 16:38:34.804703 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 169/319] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:34 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:38:34.871850 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-60eb403b-b093-4034-bf37-eb32c508992d tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:34.873573 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-60eb403b-b093-4034-bf37-eb32c508992d tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] [instance: 757d4563-fb3e-49ce-b98b-f2b522d66845] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:34.879983 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-60eb403b-b093-4034-bf37-eb32c508992d tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:34.880466 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-60eb403b-b093-4034-bf37-eb32c508992d tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:34.880897 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-60eb403b-b093-4034-bf37-eb32c508992d tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:34.881584 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-60eb403b-b093-4034-bf37-eb32c508992d tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:34.882035 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-60eb403b-b093-4034-bf37-eb32c508992d tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:34.882451 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-60eb403b-b093-4034-bf37-eb32c508992d tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:34.955641 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-808d5f48-4e09-4ce2-b199-18f6e16b9dd4 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:34.956281 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-808d5f48-4e09-4ce2-b199-18f6e16b9dd4 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:34.963632 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-808d5f48-4e09-4ce2-b199-18f6e16b9dd4 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:34.964218 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-808d5f48-4e09-4ce2-b199-18f6e16b9dd4 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:34.964909 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-808d5f48-4e09-4ce2-b199-18f6e16b9dd4 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:34.965946 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-808d5f48-4e09-4ce2-b199-18f6e16b9dd4 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:34.966408 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-808d5f48-4e09-4ce2-b199-18f6e16b9dd4 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:34.967444 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-808d5f48-4e09-4ce2-b199-18f6e16b9dd4 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:35.059251 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-60eb403b-b093-4034-bf37-eb32c508992d tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535e932c54904b83bfc19fd68df95116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c33dc11d9d41eabd986b4a4c536616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:35.068247 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-60eb403b-b093-4034-bf37-eb32c508992d tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] 10.222.0.62 "GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845" status: 200 len: 1315 microversion: 2.1 time: 0.202675 Sep 01 16:38:35.068837 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 151/320] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:34 2022] GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:35.135196 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-808d5f48-4e09-4ce2-b199-18f6e16b9dd4 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:35.147135 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-808d5f48-4e09-4ce2-b199-18f6e16b9dd4 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648" status: 200 len: 1510 microversion: 2.1 time: 0.195968 Sep 01 16:38:35.147924 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 170/321] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:34 2022] GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648 => generated 1510 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:35.696696 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-bd7c8a05-c976-47ec-b3b0-b5a8682d4e48 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:35.697421 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-bd7c8a05-c976-47ec-b3b0-b5a8682d4e48 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:35.708878 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bd7c8a05-c976-47ec-b3b0-b5a8682d4e48 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:35.709479 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bd7c8a05-c976-47ec-b3b0-b5a8682d4e48 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:35.710323 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bd7c8a05-c976-47ec-b3b0-b5a8682d4e48 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:35.711137 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bd7c8a05-c976-47ec-b3b0-b5a8682d4e48 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:35.711656 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bd7c8a05-c976-47ec-b3b0-b5a8682d4e48 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:35.712300 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bd7c8a05-c976-47ec-b3b0-b5a8682d4e48 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:35.839215 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-fc37c01d-a582-477e-bbe4-aa2da3e44064 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:35.841297 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-fc37c01d-a582-477e-bbe4-aa2da3e44064 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:35.851555 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fc37c01d-a582-477e-bbe4-aa2da3e44064 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:35.852748 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fc37c01d-a582-477e-bbe4-aa2da3e44064 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:35.854079 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fc37c01d-a582-477e-bbe4-aa2da3e44064 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:35.857339 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fc37c01d-a582-477e-bbe4-aa2da3e44064 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:35.858474 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fc37c01d-a582-477e-bbe4-aa2da3e44064 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:35.859451 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fc37c01d-a582-477e-bbe4-aa2da3e44064 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:35.928164 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-bd7c8a05-c976-47ec-b3b0-b5a8682d4e48 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:35.937680 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-bd7c8a05-c976-47ec-b3b0-b5a8682d4e48 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1259 microversion: 2.1 time: 0.244694 Sep 01 16:38:35.938275 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 152/322] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:35 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1259 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:36.090790 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1edd2166-b691-4d88-88b4-da5a04cf1bf9 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:36.091538 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1edd2166-b691-4d88-88b4-da5a04cf1bf9 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] [instance: 757d4563-fb3e-49ce-b98b-f2b522d66845] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:36.099394 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1edd2166-b691-4d88-88b4-da5a04cf1bf9 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:36.099929 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1edd2166-b691-4d88-88b4-da5a04cf1bf9 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:36.100378 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1edd2166-b691-4d88-88b4-da5a04cf1bf9 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:36.101104 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1edd2166-b691-4d88-88b4-da5a04cf1bf9 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:36.101558 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1edd2166-b691-4d88-88b4-da5a04cf1bf9 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:36.101990 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1edd2166-b691-4d88-88b4-da5a04cf1bf9 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:36.344530 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-fc37c01d-a582-477e-bbe4-aa2da3e44064 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:36.355607 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-fc37c01d-a582-477e-bbe4-aa2da3e44064 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:36.357362 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-fc37c01d-a582-477e-bbe4-aa2da3e44064 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:36.358975 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-fc37c01d-a582-477e-bbe4-aa2da3e44064 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1725 microversion: 2.20 time: 0.527079 Sep 01 16:38:36.364490 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 171/323] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:35 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1725 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:36.383369 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ebd75264-f4c2-4a5b-81e7-3c705f4a692d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:36.384119 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ebd75264-f4c2-4a5b-81e7-3c705f4a692d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:36.391786 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ebd75264-f4c2-4a5b-81e7-3c705f4a692d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:36.392321 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ebd75264-f4c2-4a5b-81e7-3c705f4a692d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:36.392894 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ebd75264-f4c2-4a5b-81e7-3c705f4a692d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:36.393670 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ebd75264-f4c2-4a5b-81e7-3c705f4a692d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:36.394298 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ebd75264-f4c2-4a5b-81e7-3c705f4a692d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:36.394895 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ebd75264-f4c2-4a5b-81e7-3c705f4a692d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:36.421121 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1edd2166-b691-4d88-88b4-da5a04cf1bf9 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535e932c54904b83bfc19fd68df95116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c33dc11d9d41eabd986b4a4c536616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:36.430354 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1edd2166-b691-4d88-88b4-da5a04cf1bf9 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] 10.222.0.62 "GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845" status: 200 len: 1315 microversion: 2.1 time: 0.343339 Sep 01 16:38:36.441645 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 153/324] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:36 2022] GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845 => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:36.568453 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ebd75264-f4c2-4a5b-81e7-3c705f4a692d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:36.592865 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ebd75264-f4c2-4a5b-81e7-3c705f4a692d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648" status: 200 len: 1510 microversion: 2.1 time: 0.226147 Sep 01 16:38:36.593436 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 172/325] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:36 2022] GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648 => generated 1510 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:36.720430 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-96578693-5c57-4fde-88d2-e14f6c659dba tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:36.730151 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-96578693-5c57-4fde-88d2-e14f6c659dba tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:36.730869 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-96578693-5c57-4fde-88d2-e14f6c659dba tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:36.731538 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-96578693-5c57-4fde-88d2-e14f6c659dba tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:36.789980 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:36.805178 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-96578693-5c57-4fde-88d2-e14f6c659dba tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Going to try to stop instance {{(pid=127198) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 16:38:36.853171 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-96578693-5c57-4fde-88d2-e14f6c659dba tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "POST /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037/action" status: 202 len: 0 microversion: 2.1 time: 0.138881 Sep 01 16:38:36.853777 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 154/326] 10.222.0.62 () {60 vars in 1278 bytes} [Thu Sep 1 16:38:36 2022] POST /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:38:36.862810 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-2e55ca51-9d59-4427-a803-e7f248ecd9d9 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:36.863422 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-2e55ca51-9d59-4427-a803-e7f248ecd9d9 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:36.869622 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2e55ca51-9d59-4427-a803-e7f248ecd9d9 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:36.870107 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2e55ca51-9d59-4427-a803-e7f248ecd9d9 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:36.870536 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2e55ca51-9d59-4427-a803-e7f248ecd9d9 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:36.871225 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2e55ca51-9d59-4427-a803-e7f248ecd9d9 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:36.871677 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2e55ca51-9d59-4427-a803-e7f248ecd9d9 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:36.872143 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2e55ca51-9d59-4427-a803-e7f248ecd9d9 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:36.960417 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9a211672-2a51-4798-b8e9-e575d489c4be tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:36.961090 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9a211672-2a51-4798-b8e9-e575d489c4be tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:36.968193 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9a211672-2a51-4798-b8e9-e575d489c4be tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:36.970112 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9a211672-2a51-4798-b8e9-e575d489c4be tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:36.971078 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9a211672-2a51-4798-b8e9-e575d489c4be tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:36.971813 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9a211672-2a51-4798-b8e9-e575d489c4be tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:36.972292 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9a211672-2a51-4798-b8e9-e575d489c4be tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:36.972911 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9a211672-2a51-4798-b8e9-e575d489c4be tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:37.012161 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-2e55ca51-9d59-4427-a803-e7f248ecd9d9 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:37.028075 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-2e55ca51-9d59-4427-a803-e7f248ecd9d9 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1722 microversion: 2.1 time: 0.162861 Sep 01 16:38:37.028075 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 173/327] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:36 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:37.125969 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9a211672-2a51-4798-b8e9-e575d489c4be tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:37.134412 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9a211672-2a51-4798-b8e9-e575d489c4be tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1259 microversion: 2.1 time: 0.178228 Sep 01 16:38:37.134984 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 155/328] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:36 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1259 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:37.385462 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e5778d16-a028-4179-bcba-a72e346a1456 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:37.386062 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e5778d16-a028-4179-bcba-a72e346a1456 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:37.393110 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e5778d16-a028-4179-bcba-a72e346a1456 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:37.393595 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e5778d16-a028-4179-bcba-a72e346a1456 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:37.394021 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e5778d16-a028-4179-bcba-a72e346a1456 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:37.394735 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e5778d16-a028-4179-bcba-a72e346a1456 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:37.395179 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e5778d16-a028-4179-bcba-a72e346a1456 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:37.395586 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e5778d16-a028-4179-bcba-a72e346a1456 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:37.452949 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5d811b44-e3d2-4848-aab5-dca364f3e670 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:37.453613 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5d811b44-e3d2-4848-aab5-dca364f3e670 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] [instance: 757d4563-fb3e-49ce-b98b-f2b522d66845] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:37.461810 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5d811b44-e3d2-4848-aab5-dca364f3e670 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:37.462343 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5d811b44-e3d2-4848-aab5-dca364f3e670 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:37.462783 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5d811b44-e3d2-4848-aab5-dca364f3e670 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:37.463840 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5d811b44-e3d2-4848-aab5-dca364f3e670 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:37.464327 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5d811b44-e3d2-4848-aab5-dca364f3e670 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:37.465022 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5d811b44-e3d2-4848-aab5-dca364f3e670 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:37.570855 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-e5778d16-a028-4179-bcba-a72e346a1456 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:37.581126 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-e5778d16-a028-4179-bcba-a72e346a1456 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:37.582583 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-e5778d16-a028-4179-bcba-a72e346a1456 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:37.584040 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e5778d16-a028-4179-bcba-a72e346a1456 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1725 microversion: 2.20 time: 0.202224 Sep 01 16:38:37.584591 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 174/329] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:37 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1725 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:37.614628 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a5a5a293-ac28-4c8b-8e58-39cc53bea3d8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:37.615338 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-a5a5a293-ac28-4c8b-8e58-39cc53bea3d8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:37.622250 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a5a5a293-ac28-4c8b-8e58-39cc53bea3d8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:37.623280 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a5a5a293-ac28-4c8b-8e58-39cc53bea3d8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:37.623841 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a5a5a293-ac28-4c8b-8e58-39cc53bea3d8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:37.624640 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a5a5a293-ac28-4c8b-8e58-39cc53bea3d8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:37.625255 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a5a5a293-ac28-4c8b-8e58-39cc53bea3d8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:37.625695 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a5a5a293-ac28-4c8b-8e58-39cc53bea3d8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:37.652432 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5d811b44-e3d2-4848-aab5-dca364f3e670 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535e932c54904b83bfc19fd68df95116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c33dc11d9d41eabd986b4a4c536616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:37.660494 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5d811b44-e3d2-4848-aab5-dca364f3e670 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] 10.222.0.62 "GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845" status: 200 len: 1315 microversion: 2.1 time: 0.213050 Sep 01 16:38:37.661370 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 156/330] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:37 2022] GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:37.782981 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-a5a5a293-ac28-4c8b-8e58-39cc53bea3d8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:37.791130 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-a5a5a293-ac28-4c8b-8e58-39cc53bea3d8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648" status: 200 len: 1510 microversion: 2.1 time: 0.180693 Sep 01 16:38:37.792024 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 175/331] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:37 2022] GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648 => generated 1510 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:38.042584 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1b60f61c-5117-4e94-8a36-e8c51fd98a9c tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:38.043241 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1b60f61c-5117-4e94-8a36-e8c51fd98a9c tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:38.050006 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1b60f61c-5117-4e94-8a36-e8c51fd98a9c tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:38.050497 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1b60f61c-5117-4e94-8a36-e8c51fd98a9c tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:38.050935 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1b60f61c-5117-4e94-8a36-e8c51fd98a9c tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:38.051637 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1b60f61c-5117-4e94-8a36-e8c51fd98a9c tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:38.052126 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1b60f61c-5117-4e94-8a36-e8c51fd98a9c tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:38.052550 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1b60f61c-5117-4e94-8a36-e8c51fd98a9c tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:38.158850 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-803f3043-1a22-4a22-a38c-2c32b281e0b3 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:38.159570 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-803f3043-1a22-4a22-a38c-2c32b281e0b3 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:38.166642 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-803f3043-1a22-4a22-a38c-2c32b281e0b3 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:38.166642 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-803f3043-1a22-4a22-a38c-2c32b281e0b3 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:38.167144 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-803f3043-1a22-4a22-a38c-2c32b281e0b3 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:38.167912 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-803f3043-1a22-4a22-a38c-2c32b281e0b3 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:38.168442 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-803f3043-1a22-4a22-a38c-2c32b281e0b3 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:38.168909 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-803f3043-1a22-4a22-a38c-2c32b281e0b3 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:38.567257 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1b60f61c-5117-4e94-8a36-e8c51fd98a9c tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:38.580303 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1b60f61c-5117-4e94-8a36-e8c51fd98a9c tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1722 microversion: 2.1 time: 0.540994 Sep 01 16:38:38.581640 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 157/332] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:38 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1722 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:38.607121 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5c40bcb0-dc06-47c9-9ddd-fa4a29e0d7d0 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:38.608062 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5c40bcb0-dc06-47c9-9ddd-fa4a29e0d7d0 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:38.614414 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5c40bcb0-dc06-47c9-9ddd-fa4a29e0d7d0 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:38.615189 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5c40bcb0-dc06-47c9-9ddd-fa4a29e0d7d0 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:38.615791 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5c40bcb0-dc06-47c9-9ddd-fa4a29e0d7d0 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:38.616753 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5c40bcb0-dc06-47c9-9ddd-fa4a29e0d7d0 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:38.617390 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5c40bcb0-dc06-47c9-9ddd-fa4a29e0d7d0 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:38.617966 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5c40bcb0-dc06-47c9-9ddd-fa4a29e0d7d0 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:38.658506 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-803f3043-1a22-4a22-a38c-2c32b281e0b3 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:38.670256 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-803f3043-1a22-4a22-a38c-2c32b281e0b3 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1259 microversion: 2.1 time: 0.516889 Sep 01 16:38:38.680607 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 176/333] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:38 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1259 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:38.699564 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-81268cd2-8bd3-48a9-95a8-e318403f8733 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:38.700363 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-81268cd2-8bd3-48a9-95a8-e318403f8733 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] [instance: 757d4563-fb3e-49ce-b98b-f2b522d66845] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:38.708256 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-81268cd2-8bd3-48a9-95a8-e318403f8733 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:38.708996 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-81268cd2-8bd3-48a9-95a8-e318403f8733 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:38.709562 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-81268cd2-8bd3-48a9-95a8-e318403f8733 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:38.710424 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-81268cd2-8bd3-48a9-95a8-e318403f8733 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:38.710944 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-81268cd2-8bd3-48a9-95a8-e318403f8733 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:38.711289 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-81268cd2-8bd3-48a9-95a8-e318403f8733 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:38.839216 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5c40bcb0-dc06-47c9-9ddd-fa4a29e0d7d0 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:38.850677 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5c40bcb0-dc06-47c9-9ddd-fa4a29e0d7d0 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:38.852623 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5c40bcb0-dc06-47c9-9ddd-fa4a29e0d7d0 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:38.854216 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5c40bcb0-dc06-47c9-9ddd-fa4a29e0d7d0 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1725 microversion: 2.20 time: 0.251254 Sep 01 16:38:38.855276 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 158/334] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:38 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1725 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:38:38.864345 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-fc9c0b3d-ecc0-4167-80fd-28cd9e264ac6 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:38.865030 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-fc9c0b3d-ecc0-4167-80fd-28cd9e264ac6 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:38.878056 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fc9c0b3d-ecc0-4167-80fd-28cd9e264ac6 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:38.889370 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fc9c0b3d-ecc0-4167-80fd-28cd9e264ac6 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:38.896109 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fc9c0b3d-ecc0-4167-80fd-28cd9e264ac6 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:38.897445 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fc9c0b3d-ecc0-4167-80fd-28cd9e264ac6 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:38.898227 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fc9c0b3d-ecc0-4167-80fd-28cd9e264ac6 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:38.899035 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fc9c0b3d-ecc0-4167-80fd-28cd9e264ac6 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:38.900176 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-81268cd2-8bd3-48a9-95a8-e318403f8733 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535e932c54904b83bfc19fd68df95116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c33dc11d9d41eabd986b4a4c536616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:38.909685 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-81268cd2-8bd3-48a9-95a8-e318403f8733 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] 10.222.0.62 "GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845" status: 200 len: 1465 microversion: 2.1 time: 0.225986 Sep 01 16:38:38.913133 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 177/335] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:38 2022] GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845 => generated 1465 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:38.965772 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c56b6362-0068-48fe-af5c-d781ed2afa9e tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:38.966416 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-c56b6362-0068-48fe-af5c-d781ed2afa9e tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] [instance: 757d4563-fb3e-49ce-b98b-f2b522d66845] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:38.973081 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c56b6362-0068-48fe-af5c-d781ed2afa9e tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:38.973868 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c56b6362-0068-48fe-af5c-d781ed2afa9e tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:38.974459 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c56b6362-0068-48fe-af5c-d781ed2afa9e tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:38.975329 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c56b6362-0068-48fe-af5c-d781ed2afa9e tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:38.975990 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c56b6362-0068-48fe-af5c-d781ed2afa9e tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:38.976704 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c56b6362-0068-48fe-af5c-d781ed2afa9e tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:39.008142 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-c56b6362-0068-48fe-af5c-d781ed2afa9e tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] [instance: 757d4563-fb3e-49ce-b98b-f2b522d66845] Going to try to terminate instance {{(pid=127199) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:38:39.108950 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-fc9c0b3d-ecc0-4167-80fd-28cd9e264ac6 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:39.121231 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-fc9c0b3d-ecc0-4167-80fd-28cd9e264ac6 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648" status: 200 len: 1510 microversion: 2.1 time: 0.264511 Sep 01 16:38:39.122759 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 159/336] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:38 2022] GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648 => generated 1510 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:39.155089 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-c56b6362-0068-48fe-af5c-d781ed2afa9e tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] 10.222.0.62 "DELETE /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845" status: 204 len: 0 microversion: 2.1 time: 0.190502 Sep 01 16:38:39.159907 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 178/337] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Sep 1 16:38:38 2022] DELETE /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 16:38:39.166142 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ea211781-ab40-4229-92e9-9fcf6e4494f2 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:39.167046 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ea211781-ab40-4229-92e9-9fcf6e4494f2 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] [instance: 757d4563-fb3e-49ce-b98b-f2b522d66845] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:39.177935 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ea211781-ab40-4229-92e9-9fcf6e4494f2 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:39.178775 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ea211781-ab40-4229-92e9-9fcf6e4494f2 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:39.181965 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ea211781-ab40-4229-92e9-9fcf6e4494f2 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:39.182707 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ea211781-ab40-4229-92e9-9fcf6e4494f2 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:39.183173 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ea211781-ab40-4229-92e9-9fcf6e4494f2 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:39.185657 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ea211781-ab40-4229-92e9-9fcf6e4494f2 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:39.418734 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ea211781-ab40-4229-92e9-9fcf6e4494f2 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535e932c54904b83bfc19fd68df95116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c33dc11d9d41eabd986b4a4c536616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:39.427019 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ea211781-ab40-4229-92e9-9fcf6e4494f2 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] 10.222.0.62 "GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845" status: 200 len: 1471 microversion: 2.1 time: 0.264904 Sep 01 16:38:39.427604 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 160/338] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:39 2022] GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845 => generated 1471 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:39.603769 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d47ae07a-9d78-4119-bb26-fdf6f07509ee tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:39.604877 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d47ae07a-9d78-4119-bb26-fdf6f07509ee tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:39.613118 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d47ae07a-9d78-4119-bb26-fdf6f07509ee tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:39.613705 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d47ae07a-9d78-4119-bb26-fdf6f07509ee tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:39.614330 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d47ae07a-9d78-4119-bb26-fdf6f07509ee tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:39.616700 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d47ae07a-9d78-4119-bb26-fdf6f07509ee tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:39.617824 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d47ae07a-9d78-4119-bb26-fdf6f07509ee tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:39.618348 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d47ae07a-9d78-4119-bb26-fdf6f07509ee tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:39.693292 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-44d961f9-8127-41ba-8ca8-7dbd718a8901 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:39.693292 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-44d961f9-8127-41ba-8ca8-7dbd718a8901 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:39.700684 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-44d961f9-8127-41ba-8ca8-7dbd718a8901 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:39.701416 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-44d961f9-8127-41ba-8ca8-7dbd718a8901 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:39.706230 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-44d961f9-8127-41ba-8ca8-7dbd718a8901 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:39.706871 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-44d961f9-8127-41ba-8ca8-7dbd718a8901 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:39.707372 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-44d961f9-8127-41ba-8ca8-7dbd718a8901 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:39.707775 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-44d961f9-8127-41ba-8ca8-7dbd718a8901 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:39.808753 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d47ae07a-9d78-4119-bb26-fdf6f07509ee tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:39.818542 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d47ae07a-9d78-4119-bb26-fdf6f07509ee tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1722 microversion: 2.1 time: 0.219210 Sep 01 16:38:39.819393 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 179/339] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:39 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:39.884993 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-6643ef07-73b4-4b12-9e29-63087ba79781 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:39.885954 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-6643ef07-73b4-4b12-9e29-63087ba79781 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:39.892877 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6643ef07-73b4-4b12-9e29-63087ba79781 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:39.893374 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6643ef07-73b4-4b12-9e29-63087ba79781 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:39.893802 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6643ef07-73b4-4b12-9e29-63087ba79781 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:39.894508 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6643ef07-73b4-4b12-9e29-63087ba79781 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:39.894991 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6643ef07-73b4-4b12-9e29-63087ba79781 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:39.895391 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-44d961f9-8127-41ba-8ca8-7dbd718a8901 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:39.895630 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6643ef07-73b4-4b12-9e29-63087ba79781 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:39.910034 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-44d961f9-8127-41ba-8ca8-7dbd718a8901 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1259 microversion: 2.1 time: 0.220983 Sep 01 16:38:39.911178 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 161/340] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:39 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1259 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:40.039715 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-6643ef07-73b4-4b12-9e29-63087ba79781 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:40.048818 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-6643ef07-73b4-4b12-9e29-63087ba79781 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:40.050243 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-6643ef07-73b4-4b12-9e29-63087ba79781 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:40.052514 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-6643ef07-73b4-4b12-9e29-63087ba79781 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1746 microversion: 2.20 time: 0.170390 Sep 01 16:38:40.052514 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 180/341] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:39 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1746 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:40.143640 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-704c0ecd-5363-44e7-93a2-bd32cd42fdbe tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:40.144291 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-704c0ecd-5363-44e7-93a2-bd32cd42fdbe tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:40.151657 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-704c0ecd-5363-44e7-93a2-bd32cd42fdbe tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:40.152187 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-704c0ecd-5363-44e7-93a2-bd32cd42fdbe tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:40.152626 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-704c0ecd-5363-44e7-93a2-bd32cd42fdbe tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:40.153321 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-704c0ecd-5363-44e7-93a2-bd32cd42fdbe tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:40.153972 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-704c0ecd-5363-44e7-93a2-bd32cd42fdbe tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:40.154286 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-704c0ecd-5363-44e7-93a2-bd32cd42fdbe tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:40.321431 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-704c0ecd-5363-44e7-93a2-bd32cd42fdbe tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:40.331834 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-704c0ecd-5363-44e7-93a2-bd32cd42fdbe tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648" status: 200 len: 1516 microversion: 2.1 time: 0.191301 Sep 01 16:38:40.331834 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 162/342] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:40 2022] GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648 => generated 1516 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:40.448111 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-01a36ec4-1779-49ee-ab9e-e1308a7a8b67 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:40.449598 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-01a36ec4-1779-49ee-ab9e-e1308a7a8b67 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] [instance: 757d4563-fb3e-49ce-b98b-f2b522d66845] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:40.458765 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-01a36ec4-1779-49ee-ab9e-e1308a7a8b67 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:40.459650 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-01a36ec4-1779-49ee-ab9e-e1308a7a8b67 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:40.460096 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-01a36ec4-1779-49ee-ab9e-e1308a7a8b67 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:40.460794 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-01a36ec4-1779-49ee-ab9e-e1308a7a8b67 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:40.461237 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-01a36ec4-1779-49ee-ab9e-e1308a7a8b67 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:40.461674 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-01a36ec4-1779-49ee-ab9e-e1308a7a8b67 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:40.607327 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-01a36ec4-1779-49ee-ab9e-e1308a7a8b67 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535e932c54904b83bfc19fd68df95116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c33dc11d9d41eabd986b4a4c536616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:40.616574 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-01a36ec4-1779-49ee-ab9e-e1308a7a8b67 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] 10.222.0.62 "GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845" status: 200 len: 1471 microversion: 2.1 time: 0.172534 Sep 01 16:38:40.624227 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 181/343] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:40 2022] GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845 => generated 1471 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:40.840441 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8b7c95a3-5ddb-4182-b635-2b1eb1666330 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:40.841158 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8b7c95a3-5ddb-4182-b635-2b1eb1666330 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:40.847589 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8b7c95a3-5ddb-4182-b635-2b1eb1666330 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:40.848114 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8b7c95a3-5ddb-4182-b635-2b1eb1666330 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:40.848554 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8b7c95a3-5ddb-4182-b635-2b1eb1666330 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:40.849354 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8b7c95a3-5ddb-4182-b635-2b1eb1666330 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:40.849660 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8b7c95a3-5ddb-4182-b635-2b1eb1666330 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:40.850092 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8b7c95a3-5ddb-4182-b635-2b1eb1666330 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:40.932465 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-900e8e31-2667-45da-91ff-bda1eb749400 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:40.932997 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-900e8e31-2667-45da-91ff-bda1eb749400 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:40.940427 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-900e8e31-2667-45da-91ff-bda1eb749400 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:40.941347 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-900e8e31-2667-45da-91ff-bda1eb749400 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:40.941836 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-900e8e31-2667-45da-91ff-bda1eb749400 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:40.942693 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-900e8e31-2667-45da-91ff-bda1eb749400 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:40.943279 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-900e8e31-2667-45da-91ff-bda1eb749400 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:40.943702 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-900e8e31-2667-45da-91ff-bda1eb749400 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:40.991692 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8b7c95a3-5ddb-4182-b635-2b1eb1666330 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:41.007529 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8b7c95a3-5ddb-4182-b635-2b1eb1666330 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1722 microversion: 2.1 time: 0.171150 Sep 01 16:38:41.008298 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 163/344] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:40 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:41.075013 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-fc222639-936e-49b7-9132-f5979391cedd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:41.075908 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-fc222639-936e-49b7-9132-f5979391cedd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:41.083494 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fc222639-936e-49b7-9132-f5979391cedd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:41.083794 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fc222639-936e-49b7-9132-f5979391cedd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:41.084498 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fc222639-936e-49b7-9132-f5979391cedd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:41.085400 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fc222639-936e-49b7-9132-f5979391cedd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:41.086018 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fc222639-936e-49b7-9132-f5979391cedd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:41.086622 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fc222639-936e-49b7-9132-f5979391cedd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:41.118399 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-900e8e31-2667-45da-91ff-bda1eb749400 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:41.126940 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-900e8e31-2667-45da-91ff-bda1eb749400 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1259 microversion: 2.1 time: 0.198940 Sep 01 16:38:41.127522 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 182/345] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:40 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1259 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:41.225406 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-fc222639-936e-49b7-9132-f5979391cedd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:41.233978 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-fc222639-936e-49b7-9132-f5979391cedd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:41.235426 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-fc222639-936e-49b7-9132-f5979391cedd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:41.236620 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-fc222639-936e-49b7-9132-f5979391cedd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1746 microversion: 2.20 time: 0.166050 Sep 01 16:38:41.237167 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 164/346] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:41 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1746 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:38:41.473532 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-0939faf7-21a6-479c-b9d0-9ce0c4addcc6 req-82a4ba83-bb5e-491c-99f6-f1dfbedebf98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ddc2614-8a62-4c61-a086-8dbab65e1f4a", "name": "network-vif-plugged", "status": "completed", "tag": "9d73b218-5a3f-4e30-9685-717b1fbfe797"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:41.485334 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-0939faf7-21a6-479c-b9d0-9ce0c4addcc6 req-82a4ba83-bb5e-491c-99f6-f1dfbedebf98 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:41.485805 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-0939faf7-21a6-479c-b9d0-9ce0c4addcc6 req-82a4ba83-bb5e-491c-99f6-f1dfbedebf98 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:41.486401 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-0939faf7-21a6-479c-b9d0-9ce0c4addcc6 req-82a4ba83-bb5e-491c-99f6-f1dfbedebf98 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:41.489326 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:41.500796 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-0939faf7-21a6-479c-b9d0-9ce0c4addcc6 req-82a4ba83-bb5e-491c-99f6-f1dfbedebf98 service nova] Creating event network-vif-plugged:9d73b218-5a3f-4e30-9685-717b1fbfe797 for instance 8ddc2614-8a62-4c61-a086-8dbab65e1f4a on hv-cinder-85221 Sep 01 16:38:41.506817 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-0939faf7-21a6-479c-b9d0-9ce0c4addcc6 req-82a4ba83-bb5e-491c-99f6-f1dfbedebf98 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037119 Sep 01 16:38:41.507415 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 183/347] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:38:41.638933 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-63dc4ec8-3b60-46ff-9588-1de849f83a5a tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:41.639516 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-63dc4ec8-3b60-46ff-9588-1de849f83a5a tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] [instance: 757d4563-fb3e-49ce-b98b-f2b522d66845] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:41.649666 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-63dc4ec8-3b60-46ff-9588-1de849f83a5a tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:41.650159 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-63dc4ec8-3b60-46ff-9588-1de849f83a5a tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:41.650612 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-63dc4ec8-3b60-46ff-9588-1de849f83a5a tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:41.651302 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-63dc4ec8-3b60-46ff-9588-1de849f83a5a tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:41.651751 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-63dc4ec8-3b60-46ff-9588-1de849f83a5a tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:41.652192 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-63dc4ec8-3b60-46ff-9588-1de849f83a5a tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:41.768547 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-f2c8a4e9-b953-46df-8765-167b6a7a3020 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Action: 'create', calling method: .version_select at 0x7f94825c2280>, body: {"keypair": {"name": "tempest-keypair-1288977164", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFidtcmgLnfIG3KgWd+2PGcOUMafu36ED6DZmUCGsR5DKMdqqDafZtTZKq/EtwBfOYqsvVzCzZM9FnJ3YXD1vSkYNctu8tPcQXqMhe5/qCvXtwUFPaSsyL0yydxcHJlsgA=="}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:41.784549 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-f2c8a4e9-b953-46df-8765-167b6a7a3020 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Getting quotas for project 601c248b5d9b48488351cb4d9561a2f4. Resources: {'key_pairs'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:38:41.789577 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-f2c8a4e9-b953-46df-8765-167b6a7a3020 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Getting quotas for user 52760b6736e14ccd8df8aca0015cb292 and project 601c248b5d9b48488351cb4d9561a2f4. Resources: {'key_pairs'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:38:41.820064 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-f2c8a4e9-b953-46df-8765-167b6a7a3020 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.057381 Sep 01 16:38:41.821025 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 184/348] 10.222.0.62 () {60 vars in 1159 bytes} [Thu Sep 1 16:38:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:38:41.846698 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-63dc4ec8-3b60-46ff-9588-1de849f83a5a tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535e932c54904b83bfc19fd68df95116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c33dc11d9d41eabd986b4a4c536616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:41.856596 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-63dc4ec8-3b60-46ff-9588-1de849f83a5a tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] 10.222.0.62 "GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845" status: 200 len: 1471 microversion: 2.1 time: 0.221577 Sep 01 16:38:41.858185 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 165/349] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:41 2022] GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845 => generated 1471 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:42.037737 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-db832699-a333-4716-8af0-c1dabc906f54 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:42.038627 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-db832699-a333-4716-8af0-c1dabc906f54 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:42.046204 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-db832699-a333-4716-8af0-c1dabc906f54 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:42.046765 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-db832699-a333-4716-8af0-c1dabc906f54 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:42.047205 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-db832699-a333-4716-8af0-c1dabc906f54 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:42.047911 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-db832699-a333-4716-8af0-c1dabc906f54 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:42.048536 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-db832699-a333-4716-8af0-c1dabc906f54 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:42.048954 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-db832699-a333-4716-8af0-c1dabc906f54 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:42.148301 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9d905c91-e264-44dd-9c39-769f49267086 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:42.149290 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9d905c91-e264-44dd-9c39-769f49267086 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:42.156889 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9d905c91-e264-44dd-9c39-769f49267086 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:42.157625 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9d905c91-e264-44dd-9c39-769f49267086 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:42.158364 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9d905c91-e264-44dd-9c39-769f49267086 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:42.159078 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9d905c91-e264-44dd-9c39-769f49267086 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:42.159689 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9d905c91-e264-44dd-9c39-769f49267086 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:42.160311 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9d905c91-e264-44dd-9c39-769f49267086 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:42.476975 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-db832699-a333-4716-8af0-c1dabc906f54 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:42.487400 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-db832699-a333-4716-8af0-c1dabc906f54 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1722 microversion: 2.1 time: 0.460713 Sep 01 16:38:42.489782 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 185/350] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:42 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1722 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:42.508269 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-802b7490-f44a-4a89-b486-238b22c12b4a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:42.509136 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-802b7490-f44a-4a89-b486-238b22c12b4a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:42.516325 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-802b7490-f44a-4a89-b486-238b22c12b4a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:42.516833 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-802b7490-f44a-4a89-b486-238b22c12b4a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:42.517422 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-802b7490-f44a-4a89-b486-238b22c12b4a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:42.518311 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-802b7490-f44a-4a89-b486-238b22c12b4a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:42.518722 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-802b7490-f44a-4a89-b486-238b22c12b4a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:42.519316 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-802b7490-f44a-4a89-b486-238b22c12b4a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:42.586813 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9d905c91-e264-44dd-9c39-769f49267086 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:42.596158 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9d905c91-e264-44dd-9c39-769f49267086 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1259 microversion: 2.1 time: 0.451608 Sep 01 16:38:42.598042 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 166/351] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:42 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1259 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:42.737701 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-802b7490-f44a-4a89-b486-238b22c12b4a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:42.747131 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-802b7490-f44a-4a89-b486-238b22c12b4a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:42.749035 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-802b7490-f44a-4a89-b486-238b22c12b4a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:42.750572 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-802b7490-f44a-4a89-b486-238b22c12b4a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1746 microversion: 2.20 time: 0.248930 Sep 01 16:38:42.751204 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 186/352] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:42 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1746 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:42.879068 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d3507c7d-ce80-4cbf-a50c-bea43b485a5d tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:42.880126 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d3507c7d-ce80-4cbf-a50c-bea43b485a5d tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] [instance: 757d4563-fb3e-49ce-b98b-f2b522d66845] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:42.886595 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d3507c7d-ce80-4cbf-a50c-bea43b485a5d tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:42.887088 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d3507c7d-ce80-4cbf-a50c-bea43b485a5d tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:42.887508 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d3507c7d-ce80-4cbf-a50c-bea43b485a5d tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:42.888268 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d3507c7d-ce80-4cbf-a50c-bea43b485a5d tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:42.888933 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d3507c7d-ce80-4cbf-a50c-bea43b485a5d tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:42.889581 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d3507c7d-ce80-4cbf-a50c-bea43b485a5d tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:43.104234 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d3507c7d-ce80-4cbf-a50c-bea43b485a5d tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535e932c54904b83bfc19fd68df95116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c33dc11d9d41eabd986b4a4c536616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:43.120484 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d3507c7d-ce80-4cbf-a50c-bea43b485a5d tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] 10.222.0.62 "GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845" status: 200 len: 1471 microversion: 2.1 time: 0.244593 Sep 01 16:38:43.122216 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 167/353] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:42 2022] GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845 => generated 1471 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:43.512821 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7b8d7a5a-11a4-4963-83f3-633728bde2bd tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:43.514319 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-7b8d7a5a-11a4-4963-83f3-633728bde2bd tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:43.525985 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7b8d7a5a-11a4-4963-83f3-633728bde2bd tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:43.526732 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7b8d7a5a-11a4-4963-83f3-633728bde2bd tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:43.528343 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7b8d7a5a-11a4-4963-83f3-633728bde2bd tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:43.529270 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7b8d7a5a-11a4-4963-83f3-633728bde2bd tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:43.531042 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7b8d7a5a-11a4-4963-83f3-633728bde2bd tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:43.534403 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7b8d7a5a-11a4-4963-83f3-633728bde2bd tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:43.619645 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-aebd7c72-5f9c-4cae-ac2e-fee662843fa0 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:43.620922 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-aebd7c72-5f9c-4cae-ac2e-fee662843fa0 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:43.630506 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-aebd7c72-5f9c-4cae-ac2e-fee662843fa0 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:43.634446 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-aebd7c72-5f9c-4cae-ac2e-fee662843fa0 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:43.640757 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-aebd7c72-5f9c-4cae-ac2e-fee662843fa0 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:43.641735 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-aebd7c72-5f9c-4cae-ac2e-fee662843fa0 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:43.642360 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-aebd7c72-5f9c-4cae-ac2e-fee662843fa0 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:43.642939 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-aebd7c72-5f9c-4cae-ac2e-fee662843fa0 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:44.024033 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-7b8d7a5a-11a4-4963-83f3-633728bde2bd tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:44.047602 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-7b8d7a5a-11a4-4963-83f3-633728bde2bd tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1722 microversion: 2.1 time: 0.538265 Sep 01 16:38:44.050022 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 187/354] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:43 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1722 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:44.063776 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d47b8778-8825-4dd0-b918-046e6b27b790 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:44.064731 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d47b8778-8825-4dd0-b918-046e6b27b790 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:44.084232 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d47b8778-8825-4dd0-b918-046e6b27b790 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:44.084665 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d47b8778-8825-4dd0-b918-046e6b27b790 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:44.085380 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d47b8778-8825-4dd0-b918-046e6b27b790 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:44.091963 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d47b8778-8825-4dd0-b918-046e6b27b790 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:44.091963 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d47b8778-8825-4dd0-b918-046e6b27b790 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:44.091963 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d47b8778-8825-4dd0-b918-046e6b27b790 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:44.097263 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-aebd7c72-5f9c-4cae-ac2e-fee662843fa0 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:44.112481 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-aebd7c72-5f9c-4cae-ac2e-fee662843fa0 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1259 microversion: 2.1 time: 0.494864 Sep 01 16:38:44.114541 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 168/355] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:43 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1259 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:44.132179 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8348054f-1437-454d-b8fb-a4a1149945e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1830994796", "imageRef": "49e5276c-002c-454f-8be8-76deb18b6b28", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "967eb9b1-fc6a-40cb-af43-8e082044e4cb"}], "security_groups": [{"name": "tempest-securitygroup--634989785"}], "key_name": "tempest-keypair-1288977164", "user_data": "}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:44.459318 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.network.neutron [None req-8348054f-1437-454d-b8fb-a4a1149945e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] validate_networks() for [('967eb9b1-fc6a-40cb-af43-8e082044e4cb', None, None, None, None, None)] {{(pid=127198) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:38:44.504588 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d47b8778-8825-4dd0-b918-046e6b27b790 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:44.530203 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d47b8778-8825-4dd0-b918-046e6b27b790 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:44.535514 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d47b8778-8825-4dd0-b918-046e6b27b790 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:44.537311 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d47b8778-8825-4dd0-b918-046e6b27b790 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1746 microversion: 2.20 time: 0.485168 Sep 01 16:38:44.538243 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 188/356] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:44 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1746 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:44.555956 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e1e18100-a4b9-43fd-9639-775a972b14b3 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:44.559258 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e1e18100-a4b9-43fd-9639-775a972b14b3 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] [instance: 757d4563-fb3e-49ce-b98b-f2b522d66845] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:44.571689 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e1e18100-a4b9-43fd-9639-775a972b14b3 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:44.573164 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e1e18100-a4b9-43fd-9639-775a972b14b3 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:44.574117 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e1e18100-a4b9-43fd-9639-775a972b14b3 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:44.574862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e1e18100-a4b9-43fd-9639-775a972b14b3 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:44.575417 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e1e18100-a4b9-43fd-9639-775a972b14b3 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:44.575802 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e1e18100-a4b9-43fd-9639-775a972b14b3 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:44.784892 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-e1e18100-a4b9-43fd-9639-775a972b14b3 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535e932c54904b83bfc19fd68df95116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c33dc11d9d41eabd986b4a4c536616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:44.796073 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e1e18100-a4b9-43fd-9639-775a972b14b3 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] 10.222.0.62 "GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845" status: 200 len: 1429 microversion: 2.1 time: 0.256361 Sep 01 16:38:44.796667 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 189/357] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:44 2022] GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845 => generated 1429 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:44.801741 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-fb8a9576-2c6d-45bb-8884-56459cc6ebd7 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Action: 'create', calling method: .version_select at 0x7f9482679040>, body: {"keypair": {"name": "tempest-keypair-1179319767", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXpDh4NXzUNABv0VL7BSvaOIPXRA5C1iAVoqZE7+jq3Uex5b8qBhrH6GoXUAs5FBbtYtwcfnP2CG7XxVc9dYx7/Elahux/YuqhHQcJ8WmfV/Tt84wfqN5i2jic45Vj/2g=="}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:44.829745 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-fb8a9576-2c6d-45bb-8884-56459cc6ebd7 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Getting quotas for project c6eb3ba21eae45898f42f3456591591e. Resources: {'key_pairs'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:38:44.834798 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-fb8a9576-2c6d-45bb-8884-56459cc6ebd7 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Getting quotas for user 3a9b222396b1438f9fa0af0e197a9293 and project c6eb3ba21eae45898f42f3456591591e. Resources: {'key_pairs'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:38:44.867650 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-fb8a9576-2c6d-45bb-8884-56459cc6ebd7 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.069530 Sep 01 16:38:44.874279 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 190/358] 10.222.0.62 () {60 vars in 1159 bytes} [Thu Sep 1 16:38:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:38:44.874279 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-1eff0462-cfbb-4601-85e4-584da69c0b47 req-d34fd569-bde1-49e3-846e-a89030421c04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "757d4563-fb3e-49ce-b98b-f2b522d66845", "name": "network-vif-deleted", "tag": "4500feb8-e551-4e82-bfe1-08ba5a216dd6"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:44.909218 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-1eff0462-cfbb-4601-85e4-584da69c0b47 req-d34fd569-bde1-49e3-846e-a89030421c04 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:44.909648 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-1eff0462-cfbb-4601-85e4-584da69c0b47 req-d34fd569-bde1-49e3-846e-a89030421c04 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:44.910101 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-1eff0462-cfbb-4601-85e4-584da69c0b47 req-d34fd569-bde1-49e3-846e-a89030421c04 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:44.941211 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-1eff0462-cfbb-4601-85e4-584da69c0b47 req-d34fd569-bde1-49e3-846e-a89030421c04 service nova] Creating event network-vif-deleted:4500feb8-e551-4e82-bfe1-08ba5a216dd6 for instance 757d4563-fb3e-49ce-b98b-f2b522d66845 on hv-cinder-85221 Sep 01 16:38:44.954463 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-1eff0462-cfbb-4601-85e4-584da69c0b47 req-d34fd569-bde1-49e3-846e-a89030421c04 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084585 Sep 01 16:38:44.961940 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 191/359] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:38:45.029820 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=96 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:45.073751 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d7f9ec78-f75e-4083-bd73-ea426173add3 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:45.074850 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d7f9ec78-f75e-4083-bd73-ea426173add3 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:45.097834 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d7f9ec78-f75e-4083-bd73-ea426173add3 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:45.099849 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d7f9ec78-f75e-4083-bd73-ea426173add3 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:45.100800 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d7f9ec78-f75e-4083-bd73-ea426173add3 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:45.103656 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d7f9ec78-f75e-4083-bd73-ea426173add3 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:45.105427 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d7f9ec78-f75e-4083-bd73-ea426173add3 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:45.107105 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d7f9ec78-f75e-4083-bd73-ea426173add3 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:45.601477 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-8348054f-1437-454d-b8fb-a4a1149945e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Flavor limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:38:45.601900 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-8348054f-1437-454d-b8fb-a4a1149945e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Image limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:38:45.602413 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-8348054f-1437-454d-b8fb-a4a1149945e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Flavor pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:38:45.602782 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-8348054f-1437-454d-b8fb-a4a1149945e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Image pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:38:45.603190 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-8348054f-1437-454d-b8fb-a4a1149945e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:38:45.643989 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d7f9ec78-f75e-4083-bd73-ea426173add3 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:45.656171 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8348054f-1437-454d-b8fb-a4a1149945e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:45.656959 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8348054f-1437-454d-b8fb-a4a1149945e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:45.657615 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8348054f-1437-454d-b8fb-a4a1149945e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:45.658581 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8348054f-1437-454d-b8fb-a4a1149945e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:45.662019 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d7f9ec78-f75e-4083-bd73-ea426173add3 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1722 microversion: 2.1 time: 0.594065 Sep 01 16:38:45.662999 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 192/360] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:45 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1722 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:45.676307 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8348054f-1437-454d-b8fb-a4a1149945e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:45.676307 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8348054f-1437-454d-b8fb-a4a1149945e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:45.685740 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ed68d3a9-2769-4db4-b2c9-cf2b158d7cd7 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:45.686576 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ed68d3a9-2769-4db4-b2c9-cf2b158d7cd7 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:45.693949 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ed68d3a9-2769-4db4-b2c9-cf2b158d7cd7 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:45.694660 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ed68d3a9-2769-4db4-b2c9-cf2b158d7cd7 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:45.695306 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ed68d3a9-2769-4db4-b2c9-cf2b158d7cd7 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:45.696489 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ed68d3a9-2769-4db4-b2c9-cf2b158d7cd7 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:45.697351 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ed68d3a9-2769-4db4-b2c9-cf2b158d7cd7 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:45.697958 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ed68d3a9-2769-4db4-b2c9-cf2b158d7cd7 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:45.709645 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-8348054f-1437-454d-b8fb-a4a1149945e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Getting quotas for project 601c248b5d9b48488351cb4d9561a2f4. Resources: {'ram', 'cores', 'instances'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:38:45.720921 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-8348054f-1437-454d-b8fb-a4a1149945e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Getting quotas for user 52760b6736e14ccd8df8aca0015cb292 and project 601c248b5d9b48488351cb4d9561a2f4. Resources: {'ram', 'cores', 'instances'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:38:45.743002 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8348054f-1437-454d-b8fb-a4a1149945e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Going to run 1 instances... {{(pid=127198) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:38:45.745520 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8348054f-1437-454d-b8fb-a4a1149945e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='49e5276c-002c-454f-8be8-76deb18b6b28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:38:45.868114 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8348054f-1437-454d-b8fb-a4a1149945e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.741466 Sep 01 16:38:45.868114 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 169/361] 10.222.0.62 () {60 vars in 1147 bytes} [Thu Sep 1 16:38:44 2022] POST /compute/v2.1/servers => generated 408 bytes in 1743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:38:45.875110 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e7a17022-c7fb-4be2-bb08-fa1d50c66d7b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:45.875869 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e7a17022-c7fb-4be2-bb08-fa1d50c66d7b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:45.886076 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e7a17022-c7fb-4be2-bb08-fa1d50c66d7b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:45.886656 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e7a17022-c7fb-4be2-bb08-fa1d50c66d7b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:45.887091 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e7a17022-c7fb-4be2-bb08-fa1d50c66d7b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:45.887853 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e7a17022-c7fb-4be2-bb08-fa1d50c66d7b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:45.888336 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e7a17022-c7fb-4be2-bb08-fa1d50c66d7b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:45.888759 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e7a17022-c7fb-4be2-bb08-fa1d50c66d7b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:46.196957 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ed68d3a9-2769-4db4-b2c9-cf2b158d7cd7 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:46.211650 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ed68d3a9-2769-4db4-b2c9-cf2b158d7cd7 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1259 microversion: 2.1 time: 0.531730 Sep 01 16:38:46.212640 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 193/362] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:45 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1259 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:46.228705 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-260397e6-4875-4362-abff-3d721ce3428a req-5624ab66-7ae3-440e-bf5a-ddc93ed685a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca59565d-e140-4bf0-9ef3-9cc18f4d3068", "name": "network-vif-plugged", "status": "completed", "tag": "c9213b9e-d8d2-4cdc-b268-1f9f700f72ec"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:46.252573 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-260397e6-4875-4362-abff-3d721ce3428a req-5624ab66-7ae3-440e-bf5a-ddc93ed685a1 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:46.253071 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-260397e6-4875-4362-abff-3d721ce3428a req-5624ab66-7ae3-440e-bf5a-ddc93ed685a1 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:46.253500 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-260397e6-4875-4362-abff-3d721ce3428a req-5624ab66-7ae3-440e-bf5a-ddc93ed685a1 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:46.275767 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-260397e6-4875-4362-abff-3d721ce3428a req-5624ab66-7ae3-440e-bf5a-ddc93ed685a1 service nova] Creating event network-vif-plugged:c9213b9e-d8d2-4cdc-b268-1f9f700f72ec for instance ca59565d-e140-4bf0-9ef3-9cc18f4d3068 on hv-cinder-85221 Sep 01 16:38:46.285576 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-260397e6-4875-4362-abff-3d721ce3428a req-5624ab66-7ae3-440e-bf5a-ddc93ed685a1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071414 Sep 01 16:38:46.286263 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 194/363] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:38:46.292547 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b5e9eede-563f-4c50-8de9-a22c69c6e658 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:46.292994 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e7a17022-c7fb-4be2-bb08-fa1d50c66d7b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:46.295587 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-b5e9eede-563f-4c50-8de9-a22c69c6e658 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] [instance: 757d4563-fb3e-49ce-b98b-f2b522d66845] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:46.295751 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:46.306852 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e7a17022-c7fb-4be2-bb08-fa1d50c66d7b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:46.307373 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b5e9eede-563f-4c50-8de9-a22c69c6e658 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:46.308121 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b5e9eede-563f-4c50-8de9-a22c69c6e658 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:46.308993 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b5e9eede-563f-4c50-8de9-a22c69c6e658 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:46.310523 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b5e9eede-563f-4c50-8de9-a22c69c6e658 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:46.311197 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b5e9eede-563f-4c50-8de9-a22c69c6e658 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:46.311794 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b5e9eede-563f-4c50-8de9-a22c69c6e658 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:46.312514 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e7a17022-c7fb-4be2-bb08-fa1d50c66d7b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:46.315636 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e7a17022-c7fb-4be2-bb08-fa1d50c66d7b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1741 microversion: 2.20 time: 0.451178 Sep 01 16:38:46.318358 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 170/364] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:45 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1741 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:46.324150 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c1105084-60de-4f40-9e57-84597a1ba4ad tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:46.327694 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c1105084-60de-4f40-9e57-84597a1ba4ad tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:46.362961 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-b5e9eede-563f-4c50-8de9-a22c69c6e658 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] HTTP exception thrown: Instance 757d4563-fb3e-49ce-b98b-f2b522d66845 could not be found. Sep 01 16:38:46.368357 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b5e9eede-563f-4c50-8de9-a22c69c6e658 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Request method failure captured: Sep 01 16:38:46.368357 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: request: GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845 HTTP/1.1 Sep 01 16:38:46.368357 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 01 16:38:46.368357 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 01 16:38:46.368357 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Connection: close Sep 01 16:38:46.368357 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 01 16:38:46.368357 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 01 16:38:46.368357 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Host: 10.222.0.62 Sep 01 16:38:46.368357 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 01 16:38:46.368357 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 01 16:38:46.368357 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjEN_thyq0dyUc2_Y91x-B8zqB_apHwLuht2tgVbFGEE-c4CHVH185OL2FoOAnaY8UqXMhqxlFbD9-oNrCKQryXaH6hgX_blOI7EMWt67zd2cpQQrOul7e6gzpr-tYERBw93UhCPuLVOPlA6oNmQQGTagZJdzDy3QG_o_AYq9FbplAZOM Sep 01 16:38:46.368357 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 01 16:38:46.368357 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 01 16:38:46.368357 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 01 16:38:46.368357 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 01 16:38:46.368357 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 01 16:38:46.368357 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 01 16:38:46.368357 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Id: b3c33dc11d9d41eabd986b4a4c536616 Sep 01 16:38:46.368357 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-VolumesNegativeTest-1112325662 Sep 01 16:38:46.368357 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 01 16:38:46.368357 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 01 16:38:46.370770 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b3c33dc11d9d41eabd986b4a4c536616"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b3c33dc11d9d41eabd986b4a4c536616"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b3c33dc11d9d41eabd986b4a4c536616"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b3c33dc11d9d41eabd986b4a4c536616"}]}] Sep 01 16:38:46.370770 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-VolumesNegativeTest-1112325662 Sep 01 16:38:46.370770 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Id: b3c33dc11d9d41eabd986b4a4c536616 Sep 01 16:38:46.370770 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-VolumesNegativeTest-1112325662 Sep 01 16:38:46.370770 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User: tempest-VolumesNegativeTest-1112325662-project Sep 01 16:38:46.370770 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 01 16:38:46.370770 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 01 16:38:46.370770 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Id: 535e932c54904b83bfc19fd68df95116 Sep 01 16:38:46.370770 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-VolumesNegativeTest-1112325662-project Sep 01 16:38:46.370770 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: method: > Sep 01 16:38:46.370770 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: exception: Instance 757d4563-fb3e-49ce-b98b-f2b522d66845 could not be found. Sep 01 16:38:46.370770 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: action_args: {'id': '757d4563-fb3e-49ce-b98b-f2b522d66845'} Sep 01 16:38:46.372029 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:38:46.372029 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:38:46.372029 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:38:46.372029 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:38:46.372029 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:38:46.372029 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:38:46.372029 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:38:46.372029 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:38:46.372029 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:38:46.372029 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:38:46.372029 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 757d4563-fb3e-49ce-b98b-f2b522d66845 could not be found. Sep 01 16:38:46.372029 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:38:46.372029 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:38:46.372029 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:38:46.372029 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:38:46.372029 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:38:46.372029 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:38:46.372029 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:38:46.372029 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:38:46.372029 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:38:46.373777 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:38:46.373777 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:38:46.373777 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:38:46.373777 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:38:46.373777 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:38:46.373777 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:38:46.373777 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:38:46.373777 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 757d4563-fb3e-49ce-b98b-f2b522d66845 could not be found. Sep 01 16:38:46.373777 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:38:46.373777 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:38:46.373777 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:38:46.373777 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:38:46.373777 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:38:46.373777 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:38:46.373777 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:38:46.373777 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:38:46.373777 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 757d4563-fb3e-49ce-b98b-f2b522d66845 could not be found. Sep 01 16:38:46.373777 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:38:46.375240 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b5e9eede-563f-4c50-8de9-a22c69c6e658 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] Returning 404 to user: Instance 757d4563-fb3e-49ce-b98b-f2b522d66845 could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:38:46.375240 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-b5e9eede-563f-4c50-8de9-a22c69c6e658 tempest-VolumesNegativeTest-1112325662 tempest-VolumesNegativeTest-1112325662-project] 10.222.0.62 "GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845" status: 404 len: 111 microversion: 2.1 time: 0.079232 Sep 01 16:38:46.375240 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 195/365] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:46 2022] GET /compute/v2.1/servers/757d4563-fb3e-49ce-b98b-f2b522d66845 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:38:46.462687 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c1105084-60de-4f40-9e57-84597a1ba4ad tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:46.475239 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c1105084-60de-4f40-9e57-84597a1ba4ad tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 200 len: 1246 microversion: 2.1 time: 0.155392 Sep 01 16:38:46.475981 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 171/366] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:46 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 1246 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:46.687985 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7d5196b3-c0e3-416b-8401-9f6f6a2fcf24 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:46.688680 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-7d5196b3-c0e3-416b-8401-9f6f6a2fcf24 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:46.699151 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7d5196b3-c0e3-416b-8401-9f6f6a2fcf24 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:46.700072 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7d5196b3-c0e3-416b-8401-9f6f6a2fcf24 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:46.700634 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7d5196b3-c0e3-416b-8401-9f6f6a2fcf24 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:46.702567 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7d5196b3-c0e3-416b-8401-9f6f6a2fcf24 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:46.703359 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7d5196b3-c0e3-416b-8401-9f6f6a2fcf24 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:46.704036 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7d5196b3-c0e3-416b-8401-9f6f6a2fcf24 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:46.977835 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-7d5196b3-c0e3-416b-8401-9f6f6a2fcf24 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:46.993201 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-7d5196b3-c0e3-416b-8401-9f6f6a2fcf24 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1722 microversion: 2.1 time: 0.312801 Sep 01 16:38:46.994610 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 196/367] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:46 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1722 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:47.238260 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2bd984a4-cbb7-4f4a-a3b8-37cc07a3b831 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:47.240602 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-2bd984a4-cbb7-4f4a-a3b8-37cc07a3b831 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:47.252859 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2bd984a4-cbb7-4f4a-a3b8-37cc07a3b831 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:47.253972 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2bd984a4-cbb7-4f4a-a3b8-37cc07a3b831 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:47.265339 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2bd984a4-cbb7-4f4a-a3b8-37cc07a3b831 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:47.268580 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2bd984a4-cbb7-4f4a-a3b8-37cc07a3b831 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:47.269263 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2bd984a4-cbb7-4f4a-a3b8-37cc07a3b831 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:47.270789 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2bd984a4-cbb7-4f4a-a3b8-37cc07a3b831 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:47.350829 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c72fa26c-c31f-4007-8a49-15a4e90823b4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:47.351483 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-c72fa26c-c31f-4007-8a49-15a4e90823b4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:47.385218 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c72fa26c-c31f-4007-8a49-15a4e90823b4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:47.389653 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c72fa26c-c31f-4007-8a49-15a4e90823b4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:47.390504 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c72fa26c-c31f-4007-8a49-15a4e90823b4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:47.391659 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c72fa26c-c31f-4007-8a49-15a4e90823b4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:47.399144 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c72fa26c-c31f-4007-8a49-15a4e90823b4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:47.400232 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c72fa26c-c31f-4007-8a49-15a4e90823b4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:47.739811 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2bd984a4-cbb7-4f4a-a3b8-37cc07a3b831 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:47.769401 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2bd984a4-cbb7-4f4a-a3b8-37cc07a3b831 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1259 microversion: 2.1 time: 0.538816 Sep 01 16:38:47.783212 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 172/368] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:47 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1259 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:47.788350 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7a773078-6826-41ed-9219-235bf083d26a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:47.789289 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7a773078-6826-41ed-9219-235bf083d26a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:47.799462 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7a773078-6826-41ed-9219-235bf083d26a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:47.800090 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7a773078-6826-41ed-9219-235bf083d26a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:47.800746 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7a773078-6826-41ed-9219-235bf083d26a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:47.802399 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7a773078-6826-41ed-9219-235bf083d26a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:47.803983 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7a773078-6826-41ed-9219-235bf083d26a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:47.804757 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7a773078-6826-41ed-9219-235bf083d26a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:48.147061 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7a773078-6826-41ed-9219-235bf083d26a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:48.160083 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7a773078-6826-41ed-9219-235bf083d26a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 200 len: 1250 microversion: 2.1 time: 0.375468 Sep 01 16:38:48.174372 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 173/369] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:47 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 1250 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:48.179752 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6a97c10b-3c0d-4725-9e39-2d1a833c0777 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-768137226", "imageRef": "49e5276c-002c-454f-8be8-76deb18b6b28", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3ad8e59d-1d82-4cdb-9afd-98e6a7c8e50a"}], "security_groups": [{"name": "tempest-securitygroup--2115343319"}], "key_name": "tempest-keypair-1179319767", "user_data": "}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:48.188733 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c72fa26c-c31f-4007-8a49-15a4e90823b4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:48.198492 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c72fa26c-c31f-4007-8a49-15a4e90823b4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:48.206585 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c72fa26c-c31f-4007-8a49-15a4e90823b4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:48.209638 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-c72fa26c-c31f-4007-8a49-15a4e90823b4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1741 microversion: 2.20 time: 0.863399 Sep 01 16:38:48.213222 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 197/370] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:47 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1741 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:48.218918 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-5d45c421-8465-4ebc-b7c9-92cd9d006ba5 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:48.226585 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-5d45c421-8465-4ebc-b7c9-92cd9d006ba5 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:48.240920 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5d45c421-8465-4ebc-b7c9-92cd9d006ba5 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:48.241415 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5d45c421-8465-4ebc-b7c9-92cd9d006ba5 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:48.241884 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5d45c421-8465-4ebc-b7c9-92cd9d006ba5 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:48.242687 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5d45c421-8465-4ebc-b7c9-92cd9d006ba5 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:48.243194 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5d45c421-8465-4ebc-b7c9-92cd9d006ba5 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:48.243634 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5d45c421-8465-4ebc-b7c9-92cd9d006ba5 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:48.429479 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.network.neutron [None req-6a97c10b-3c0d-4725-9e39-2d1a833c0777 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] validate_networks() for [('3ad8e59d-1d82-4cdb-9afd-98e6a7c8e50a', None, None, None, None, None)] {{(pid=127198) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:38:48.787740 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-5d45c421-8465-4ebc-b7c9-92cd9d006ba5 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:48.815088 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-5d45c421-8465-4ebc-b7c9-92cd9d006ba5 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1722 microversion: 2.1 time: 0.600590 Sep 01 16:38:48.817534 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 198/371] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:48 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1722 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:48.836146 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-1310f4c8-f059-4fcb-9f95-a918c7a58582 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:48.836146 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-1310f4c8-f059-4fcb-9f95-a918c7a58582 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:48.850450 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1310f4c8-f059-4fcb-9f95-a918c7a58582 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:48.851202 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1310f4c8-f059-4fcb-9f95-a918c7a58582 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:48.851911 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1310f4c8-f059-4fcb-9f95-a918c7a58582 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:48.856922 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1310f4c8-f059-4fcb-9f95-a918c7a58582 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:48.858232 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1310f4c8-f059-4fcb-9f95-a918c7a58582 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:48.859034 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1310f4c8-f059-4fcb-9f95-a918c7a58582 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:49.429626 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-1310f4c8-f059-4fcb-9f95-a918c7a58582 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:49.451370 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-1310f4c8-f059-4fcb-9f95-a918c7a58582 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1259 microversion: 2.1 time: 0.629678 Sep 01 16:38:49.452308 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 199/372] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:48 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1259 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:49.458695 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-06f59e25-f98c-4808-95ab-2d296fbba805 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:49.459308 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-06f59e25-f98c-4808-95ab-2d296fbba805 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:49.486784 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-06f59e25-f98c-4808-95ab-2d296fbba805 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:49.487327 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-06f59e25-f98c-4808-95ab-2d296fbba805 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:49.487761 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-06f59e25-f98c-4808-95ab-2d296fbba805 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:49.493501 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-06f59e25-f98c-4808-95ab-2d296fbba805 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:49.498525 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-06f59e25-f98c-4808-95ab-2d296fbba805 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:49.502145 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-06f59e25-f98c-4808-95ab-2d296fbba805 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:49.624230 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-06f59e25-f98c-4808-95ab-2d296fbba805 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:49.642670 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-06f59e25-f98c-4808-95ab-2d296fbba805 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 200 len: 1298 microversion: 2.1 time: 0.189209 Sep 01 16:38:49.644280 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 200/373] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:49 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 1298 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:49.659999 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-254f13c8-5556-4a0b-b1f1-0b3d620502cc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:49.661546 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-254f13c8-5556-4a0b-b1f1-0b3d620502cc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:49.668409 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-254f13c8-5556-4a0b-b1f1-0b3d620502cc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:49.669212 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-254f13c8-5556-4a0b-b1f1-0b3d620502cc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:49.669788 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-254f13c8-5556-4a0b-b1f1-0b3d620502cc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:49.670745 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-254f13c8-5556-4a0b-b1f1-0b3d620502cc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:49.671266 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-254f13c8-5556-4a0b-b1f1-0b3d620502cc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:49.672113 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-254f13c8-5556-4a0b-b1f1-0b3d620502cc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:49.688807 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-6a97c10b-3c0d-4725-9e39-2d1a833c0777 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Flavor limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:38:49.689349 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-6a97c10b-3c0d-4725-9e39-2d1a833c0777 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Image limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:38:49.689697 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-6a97c10b-3c0d-4725-9e39-2d1a833c0777 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Flavor pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:38:49.690145 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-6a97c10b-3c0d-4725-9e39-2d1a833c0777 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Image pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:38:49.690556 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-6a97c10b-3c0d-4725-9e39-2d1a833c0777 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:38:49.707959 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6a97c10b-3c0d-4725-9e39-2d1a833c0777 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:49.713640 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6a97c10b-3c0d-4725-9e39-2d1a833c0777 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:49.714281 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6a97c10b-3c0d-4725-9e39-2d1a833c0777 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:49.715362 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6a97c10b-3c0d-4725-9e39-2d1a833c0777 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:49.715879 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6a97c10b-3c0d-4725-9e39-2d1a833c0777 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:49.716344 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6a97c10b-3c0d-4725-9e39-2d1a833c0777 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:49.744037 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-6a97c10b-3c0d-4725-9e39-2d1a833c0777 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Getting quotas for project c6eb3ba21eae45898f42f3456591591e. Resources: {'ram', 'cores', 'instances'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:38:49.752669 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-6a97c10b-3c0d-4725-9e39-2d1a833c0777 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Getting quotas for user 3a9b222396b1438f9fa0af0e197a9293 and project c6eb3ba21eae45898f42f3456591591e. Resources: {'ram', 'cores', 'instances'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:38:49.768420 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-6a97c10b-3c0d-4725-9e39-2d1a833c0777 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Going to run 1 instances... {{(pid=127198) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:38:49.772220 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-6a97c10b-3c0d-4725-9e39-2d1a833c0777 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: c22c916b-390e-4bfe-8529-695bac5e5629] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='49e5276c-002c-454f-8be8-76deb18b6b28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:38:49.834903 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-6a97c10b-3c0d-4725-9e39-2d1a833c0777 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.659175 Sep 01 16:38:49.835843 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 174/374] 10.222.0.62 () {60 vars in 1147 bytes} [Thu Sep 1 16:38:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 1661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:38:49.840934 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c847d261-2833-4d35-993a-d7c44738ffcc tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:49.842209 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c847d261-2833-4d35-993a-d7c44738ffcc tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:49.850133 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c847d261-2833-4d35-993a-d7c44738ffcc tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:49.850977 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c847d261-2833-4d35-993a-d7c44738ffcc tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:49.851598 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c847d261-2833-4d35-993a-d7c44738ffcc tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:49.852530 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c847d261-2833-4d35-993a-d7c44738ffcc tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:49.853387 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c847d261-2833-4d35-993a-d7c44738ffcc tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:49.853967 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c847d261-2833-4d35-993a-d7c44738ffcc tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:50.014617 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-254f13c8-5556-4a0b-b1f1-0b3d620502cc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:50.027974 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-254f13c8-5556-4a0b-b1f1-0b3d620502cc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:50.030666 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-254f13c8-5556-4a0b-b1f1-0b3d620502cc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:50.033092 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-254f13c8-5556-4a0b-b1f1-0b3d620502cc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1741 microversion: 2.20 time: 0.386003 Sep 01 16:38:50.052407 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 201/375] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:49 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1741 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:50.057708 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-eccfcb75-86f9-4a2e-96e6-f487dee70c1e tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:50.058637 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-eccfcb75-86f9-4a2e-96e6-f487dee70c1e tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: c22c916b-390e-4bfe-8529-695bac5e5629] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:50.072642 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c847d261-2833-4d35-993a-d7c44738ffcc tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:50.084540 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c847d261-2833-4d35-993a-d7c44738ffcc tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1722 microversion: 2.1 time: 0.247413 Sep 01 16:38:50.085929 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 175/376] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:49 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1722 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:50.169978 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-eccfcb75-86f9-4a2e-96e6-f487dee70c1e tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:50.181031 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-eccfcb75-86f9-4a2e-96e6-f487dee70c1e tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629" status: 200 len: 1241 microversion: 2.1 time: 0.125739 Sep 01 16:38:50.192366 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 202/377] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:50 2022] GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629 => generated 1241 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:50.473961 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-66881bb3-9a0d-406d-97d5-7c481173fe0a tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:50.474946 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-66881bb3-9a0d-406d-97d5-7c481173fe0a tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:50.482681 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-66881bb3-9a0d-406d-97d5-7c481173fe0a tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:50.483967 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-66881bb3-9a0d-406d-97d5-7c481173fe0a tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:50.484760 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-66881bb3-9a0d-406d-97d5-7c481173fe0a tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:50.485663 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-66881bb3-9a0d-406d-97d5-7c481173fe0a tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:50.486612 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-66881bb3-9a0d-406d-97d5-7c481173fe0a tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:50.487932 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-66881bb3-9a0d-406d-97d5-7c481173fe0a tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:50.667416 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c87007f1-e69d-42bf-8390-73d5de777a41 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:50.668923 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-c87007f1-e69d-42bf-8390-73d5de777a41 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:50.671770 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:50.677765 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c87007f1-e69d-42bf-8390-73d5de777a41 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:50.680780 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c87007f1-e69d-42bf-8390-73d5de777a41 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:50.681456 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c87007f1-e69d-42bf-8390-73d5de777a41 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:50.682584 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c87007f1-e69d-42bf-8390-73d5de777a41 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:50.687236 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c87007f1-e69d-42bf-8390-73d5de777a41 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:50.688153 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c87007f1-e69d-42bf-8390-73d5de777a41 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:50.776486 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-66881bb3-9a0d-406d-97d5-7c481173fe0a tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:50.799107 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-66881bb3-9a0d-406d-97d5-7c481173fe0a tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1259 microversion: 2.1 time: 0.327974 Sep 01 16:38:50.813722 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 176/378] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:50 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1259 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:50.820597 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c87007f1-e69d-42bf-8390-73d5de777a41 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:50.839731 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-c87007f1-e69d-42bf-8390-73d5de777a41 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 200 len: 1298 microversion: 2.1 time: 0.173486 Sep 01 16:38:50.842949 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 203/379] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:50 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 1298 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:51.058120 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5c2241bf-4dee-462b-9a36-393d00104b2b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:51.058982 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5c2241bf-4dee-462b-9a36-393d00104b2b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:51.074199 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5c2241bf-4dee-462b-9a36-393d00104b2b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:51.076547 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5c2241bf-4dee-462b-9a36-393d00104b2b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:51.078818 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5c2241bf-4dee-462b-9a36-393d00104b2b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:51.080427 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5c2241bf-4dee-462b-9a36-393d00104b2b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:51.081127 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5c2241bf-4dee-462b-9a36-393d00104b2b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:51.082991 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5c2241bf-4dee-462b-9a36-393d00104b2b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:51.111166 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-2cf5e7d3-7261-4a61-94df-c5ef001616c0 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:51.112021 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-2cf5e7d3-7261-4a61-94df-c5ef001616c0 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:51.128268 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2cf5e7d3-7261-4a61-94df-c5ef001616c0 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:51.130214 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2cf5e7d3-7261-4a61-94df-c5ef001616c0 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:51.132389 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2cf5e7d3-7261-4a61-94df-c5ef001616c0 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:51.138839 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2cf5e7d3-7261-4a61-94df-c5ef001616c0 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:51.139596 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2cf5e7d3-7261-4a61-94df-c5ef001616c0 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:51.144164 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2cf5e7d3-7261-4a61-94df-c5ef001616c0 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:51.533095 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5c2241bf-4dee-462b-9a36-393d00104b2b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:51.542633 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5c2241bf-4dee-462b-9a36-393d00104b2b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:51.549470 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5c2241bf-4dee-462b-9a36-393d00104b2b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:51.551074 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5c2241bf-4dee-462b-9a36-393d00104b2b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1741 microversion: 2.20 time: 0.497279 Sep 01 16:38:51.552956 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 177/380] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:51 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1741 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:51.562585 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-2cf5e7d3-7261-4a61-94df-c5ef001616c0 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:51.578477 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ccce4169-9da3-4a92-a3e3-cb9a31f4272f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:51.579106 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ccce4169-9da3-4a92-a3e3-cb9a31f4272f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: c22c916b-390e-4bfe-8529-695bac5e5629] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:51.583112 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-2cf5e7d3-7261-4a61-94df-c5ef001616c0 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1722 microversion: 2.1 time: 0.478815 Sep 01 16:38:51.583710 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 204/381] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:51 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1722 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:51.587512 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ccce4169-9da3-4a92-a3e3-cb9a31f4272f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:51.588262 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ccce4169-9da3-4a92-a3e3-cb9a31f4272f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:51.589185 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ccce4169-9da3-4a92-a3e3-cb9a31f4272f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:51.590072 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ccce4169-9da3-4a92-a3e3-cb9a31f4272f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:51.590829 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ccce4169-9da3-4a92-a3e3-cb9a31f4272f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:51.591417 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ccce4169-9da3-4a92-a3e3-cb9a31f4272f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:51.832923 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-9259fa3e-c440-49cb-9f6c-802296cfa79b tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:51.834558 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-9259fa3e-c440-49cb-9f6c-802296cfa79b tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:51.855663 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9259fa3e-c440-49cb-9f6c-802296cfa79b tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:51.859285 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9259fa3e-c440-49cb-9f6c-802296cfa79b tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:51.860046 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9259fa3e-c440-49cb-9f6c-802296cfa79b tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:51.862154 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9259fa3e-c440-49cb-9f6c-802296cfa79b tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:51.866895 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9259fa3e-c440-49cb-9f6c-802296cfa79b tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:51.867603 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9259fa3e-c440-49cb-9f6c-802296cfa79b tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:51.900071 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ccce4169-9da3-4a92-a3e3-cb9a31f4272f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:51.938174 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=100 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:51.939421 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ccce4169-9da3-4a92-a3e3-cb9a31f4272f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629" status: 200 len: 1237 microversion: 2.1 time: 0.373074 Sep 01 16:38:51.940472 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 178/382] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:51 2022] GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629 => generated 1237 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:51.956422 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c142e038-f82e-4584-a1ad-de9b79c4989f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:51.957526 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c142e038-f82e-4584-a1ad-de9b79c4989f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:51.995673 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c142e038-f82e-4584-a1ad-de9b79c4989f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:51.997558 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c142e038-f82e-4584-a1ad-de9b79c4989f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:51.999224 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c142e038-f82e-4584-a1ad-de9b79c4989f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:52.004537 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c142e038-f82e-4584-a1ad-de9b79c4989f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:52.005386 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c142e038-f82e-4584-a1ad-de9b79c4989f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:52.007135 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c142e038-f82e-4584-a1ad-de9b79c4989f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:52.281337 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c142e038-f82e-4584-a1ad-de9b79c4989f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:52.291503 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c142e038-f82e-4584-a1ad-de9b79c4989f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 200 len: 1304 microversion: 2.1 time: 0.349931 Sep 01 16:38:52.296660 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 179/383] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:51 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 1304 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:52.395729 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-9259fa3e-c440-49cb-9f6c-802296cfa79b tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:52.408016 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-9259fa3e-c440-49cb-9f6c-802296cfa79b tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1443 microversion: 2.1 time: 0.579237 Sep 01 16:38:52.408996 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 205/384] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:51 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1443 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:52.439833 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-633ccf25-e13a-4a4c-91f3-83500a2b5fd5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:52.440662 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-633ccf25-e13a-4a4c-91f3-83500a2b5fd5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:52.454025 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-633ccf25-e13a-4a4c-91f3-83500a2b5fd5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:52.454855 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-633ccf25-e13a-4a4c-91f3-83500a2b5fd5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:52.455555 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-633ccf25-e13a-4a4c-91f3-83500a2b5fd5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:52.456712 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-633ccf25-e13a-4a4c-91f3-83500a2b5fd5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:52.463224 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-633ccf25-e13a-4a4c-91f3-83500a2b5fd5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:52.468415 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-633ccf25-e13a-4a4c-91f3-83500a2b5fd5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:52.581754 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-eeed161b-fe61-43f6-bbbe-10519ce04afd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:52.582376 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-eeed161b-fe61-43f6-bbbe-10519ce04afd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:52.597732 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eeed161b-fe61-43f6-bbbe-10519ce04afd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:52.600261 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eeed161b-fe61-43f6-bbbe-10519ce04afd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:52.601579 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eeed161b-fe61-43f6-bbbe-10519ce04afd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:52.602423 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eeed161b-fe61-43f6-bbbe-10519ce04afd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:52.602915 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eeed161b-fe61-43f6-bbbe-10519ce04afd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:52.603805 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eeed161b-fe61-43f6-bbbe-10519ce04afd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:52.969323 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-633ccf25-e13a-4a4c-91f3-83500a2b5fd5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:52.973849 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-eeed161b-fe61-43f6-bbbe-10519ce04afd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:52.992878 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-633ccf25-e13a-4a4c-91f3-83500a2b5fd5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1443 microversion: 2.1 time: 0.557353 Sep 01 16:38:52.996318 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-eeed161b-fe61-43f6-bbbe-10519ce04afd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:52.999538 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-eeed161b-fe61-43f6-bbbe-10519ce04afd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:53.000086 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 180/385] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:52 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1443 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:53.005330 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-eeed161b-fe61-43f6-bbbe-10519ce04afd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1741 microversion: 2.20 time: 0.430417 Sep 01 16:38:53.007211 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 206/386] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:52 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1741 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:53.041718 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9f2ae81d-4b9a-4ca1-8031-ec93a347f0e4 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:53.043563 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9f2ae81d-4b9a-4ca1-8031-ec93a347f0e4 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:53.053648 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7dd78f95-fbf7-4271-a34f-72aa7e8fee0c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:53.057195 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-7dd78f95-fbf7-4271-a34f-72aa7e8fee0c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: c22c916b-390e-4bfe-8529-695bac5e5629] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:53.062723 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9f2ae81d-4b9a-4ca1-8031-ec93a347f0e4 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:53.063920 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9f2ae81d-4b9a-4ca1-8031-ec93a347f0e4 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:53.065147 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9f2ae81d-4b9a-4ca1-8031-ec93a347f0e4 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:53.066333 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9f2ae81d-4b9a-4ca1-8031-ec93a347f0e4 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:53.069382 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9f2ae81d-4b9a-4ca1-8031-ec93a347f0e4 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:53.071191 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9f2ae81d-4b9a-4ca1-8031-ec93a347f0e4 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:53.075753 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7dd78f95-fbf7-4271-a34f-72aa7e8fee0c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:53.081843 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7dd78f95-fbf7-4271-a34f-72aa7e8fee0c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:53.084431 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7dd78f95-fbf7-4271-a34f-72aa7e8fee0c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:53.088068 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7dd78f95-fbf7-4271-a34f-72aa7e8fee0c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:53.088796 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7dd78f95-fbf7-4271-a34f-72aa7e8fee0c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:53.090263 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7dd78f95-fbf7-4271-a34f-72aa7e8fee0c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:53.387140 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-7dd78f95-fbf7-4271-a34f-72aa7e8fee0c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:53.411001 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-7dd78f95-fbf7-4271-a34f-72aa7e8fee0c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629" status: 200 len: 1293 microversion: 2.1 time: 0.372814 Sep 01 16:38:53.415690 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 207/387] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:53 2022] GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629 => generated 1293 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:53.439804 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-dff03a87-e753-4c04-9d0a-b8df5ec2ce97 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:53.440978 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-dff03a87-e753-4c04-9d0a-b8df5ec2ce97 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:53.489993 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dff03a87-e753-4c04-9d0a-b8df5ec2ce97 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:53.490582 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dff03a87-e753-4c04-9d0a-b8df5ec2ce97 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:53.491027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dff03a87-e753-4c04-9d0a-b8df5ec2ce97 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:53.492470 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dff03a87-e753-4c04-9d0a-b8df5ec2ce97 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:53.493504 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dff03a87-e753-4c04-9d0a-b8df5ec2ce97 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:53.495706 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dff03a87-e753-4c04-9d0a-b8df5ec2ce97 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:53.661453 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-dff03a87-e753-4c04-9d0a-b8df5ec2ce97 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:53.683476 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-dff03a87-e753-4c04-9d0a-b8df5ec2ce97 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 200 len: 1304 microversion: 2.1 time: 0.265728 Sep 01 16:38:53.684749 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 208/388] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:53 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 1304 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:53.741495 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9f2ae81d-4b9a-4ca1-8031-ec93a347f0e4 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:53.762964 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9f2ae81d-4b9a-4ca1-8031-ec93a347f0e4 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1722 microversion: 2.1 time: 0.759903 Sep 01 16:38:53.768299 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 181/389] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:53 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1722 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:54.040751 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-2e1b1282-b562-43be-8628-cb81a6ee6c57 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:54.041351 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-2e1b1282-b562-43be-8628-cb81a6ee6c57 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:54.057706 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2e1b1282-b562-43be-8628-cb81a6ee6c57 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:54.058210 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2e1b1282-b562-43be-8628-cb81a6ee6c57 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:54.058642 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2e1b1282-b562-43be-8628-cb81a6ee6c57 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:54.063105 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2e1b1282-b562-43be-8628-cb81a6ee6c57 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:54.063595 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2e1b1282-b562-43be-8628-cb81a6ee6c57 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:54.064069 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2e1b1282-b562-43be-8628-cb81a6ee6c57 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:54.452021 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b6aa2643-cc30-4202-bbd3-5086ba5454ad tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:54.453787 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b6aa2643-cc30-4202-bbd3-5086ba5454ad tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: c22c916b-390e-4bfe-8529-695bac5e5629] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:54.470329 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b6aa2643-cc30-4202-bbd3-5086ba5454ad tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:54.484592 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b6aa2643-cc30-4202-bbd3-5086ba5454ad tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:54.485452 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b6aa2643-cc30-4202-bbd3-5086ba5454ad tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:54.486521 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b6aa2643-cc30-4202-bbd3-5086ba5454ad tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:54.486931 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b6aa2643-cc30-4202-bbd3-5086ba5454ad tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:54.487370 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b6aa2643-cc30-4202-bbd3-5086ba5454ad tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:54.590923 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-2e1b1282-b562-43be-8628-cb81a6ee6c57 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:54.606510 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-2e1b1282-b562-43be-8628-cb81a6ee6c57 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:54.613637 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-2e1b1282-b562-43be-8628-cb81a6ee6c57 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:54.619246 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-2e1b1282-b562-43be-8628-cb81a6ee6c57 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1741 microversion: 2.20 time: 0.582421 Sep 01 16:38:54.646812 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 209/390] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:54 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1741 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:54.720951 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-248b78ec-1e63-4128-a132-348d2a5a17c5 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:54.720951 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-248b78ec-1e63-4128-a132-348d2a5a17c5 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:54.727749 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-248b78ec-1e63-4128-a132-348d2a5a17c5 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:54.728426 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-248b78ec-1e63-4128-a132-348d2a5a17c5 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:54.728933 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-248b78ec-1e63-4128-a132-348d2a5a17c5 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:54.729702 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-248b78ec-1e63-4128-a132-348d2a5a17c5 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:54.730173 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-248b78ec-1e63-4128-a132-348d2a5a17c5 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:54.744823 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-248b78ec-1e63-4128-a132-348d2a5a17c5 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:54.906361 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b6aa2643-cc30-4202-bbd3-5086ba5454ad tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:54.925405 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b6aa2643-cc30-4202-bbd3-5086ba5454ad tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629" status: 200 len: 1299 microversion: 2.1 time: 0.478370 Sep 01 16:38:54.931326 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 182/391] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:54 2022] GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629 => generated 1299 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:54.956241 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-61020c08-0cb8-405c-8a0f-6be8e5e3664b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:54.958428 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-61020c08-0cb8-405c-8a0f-6be8e5e3664b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:54.989777 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-61020c08-0cb8-405c-8a0f-6be8e5e3664b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:54.994555 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-61020c08-0cb8-405c-8a0f-6be8e5e3664b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:54.995738 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-61020c08-0cb8-405c-8a0f-6be8e5e3664b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:55.000547 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-61020c08-0cb8-405c-8a0f-6be8e5e3664b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:55.001425 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-61020c08-0cb8-405c-8a0f-6be8e5e3664b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:55.002436 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-61020c08-0cb8-405c-8a0f-6be8e5e3664b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:55.394399 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-248b78ec-1e63-4128-a132-348d2a5a17c5 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:55.403640 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-248b78ec-1e63-4128-a132-348d2a5a17c5 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 200 len: 1371 microversion: 2.1 time: 0.692090 Sep 01 16:38:55.408236 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 210/392] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:54 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 1371 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:55.582631 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-61020c08-0cb8-405c-8a0f-6be8e5e3664b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:55.598932 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-61020c08-0cb8-405c-8a0f-6be8e5e3664b tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1699 microversion: 2.1 time: 0.661550 Sep 01 16:38:55.615241 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 183/393] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:54 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1699 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:55.620946 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c84b8287-c47d-4c82-8512-993f4f65762f tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:55.641502 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c84b8287-c47d-4c82-8512-993f4f65762f tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:55.642005 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c84b8287-c47d-4c82-8512-993f4f65762f tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:55.642431 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c84b8287-c47d-4c82-8512-993f4f65762f tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:55.654204 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3ed0ebe0-062e-4863-8b66-db99b7ebb7fa tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:55.654913 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-3ed0ebe0-062e-4863-8b66-db99b7ebb7fa tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:55.671681 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3ed0ebe0-062e-4863-8b66-db99b7ebb7fa tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:55.672327 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3ed0ebe0-062e-4863-8b66-db99b7ebb7fa tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:55.672851 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3ed0ebe0-062e-4863-8b66-db99b7ebb7fa tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:55.673804 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3ed0ebe0-062e-4863-8b66-db99b7ebb7fa tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:55.674462 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3ed0ebe0-062e-4863-8b66-db99b7ebb7fa tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:55.675081 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3ed0ebe0-062e-4863-8b66-db99b7ebb7fa tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:55.775671 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-c84b8287-c47d-4c82-8512-993f4f65762f tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Going to try to start instance {{(pid=127199) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 01 16:38:55.831504 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-c84b8287-c47d-4c82-8512-993f4f65762f tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "POST /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037/action" status: 202 len: 0 microversion: 2.1 time: 0.214509 Sep 01 16:38:55.836072 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 211/394] 10.222.0.62 () {60 vars in 1278 bytes} [Thu Sep 1 16:38:55 2022] POST /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 16:38:55.844637 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-17caeb6b-509f-441e-8e79-7136fd27675e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:55.845614 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-17caeb6b-509f-441e-8e79-7136fd27675e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:55.869117 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-17caeb6b-509f-441e-8e79-7136fd27675e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:55.870127 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-17caeb6b-509f-441e-8e79-7136fd27675e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:55.870975 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-17caeb6b-509f-441e-8e79-7136fd27675e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:55.873199 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-17caeb6b-509f-441e-8e79-7136fd27675e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:55.874755 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-17caeb6b-509f-441e-8e79-7136fd27675e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:55.875522 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-17caeb6b-509f-441e-8e79-7136fd27675e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:56.595928 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3ed0ebe0-062e-4863-8b66-db99b7ebb7fa tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:56.657812 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3ed0ebe0-062e-4863-8b66-db99b7ebb7fa tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:56.661783 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3ed0ebe0-062e-4863-8b66-db99b7ebb7fa tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:56.674130 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3ed0ebe0-062e-4863-8b66-db99b7ebb7fa tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1741 microversion: 2.20 time: 1.023639 Sep 01 16:38:56.675776 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 184/395] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:55 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1741 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:56.693619 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f7ba3ba8-f068-4572-b085-17fa19688fce tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:56.694786 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f7ba3ba8-f068-4572-b085-17fa19688fce tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: c22c916b-390e-4bfe-8529-695bac5e5629] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:56.712543 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f7ba3ba8-f068-4572-b085-17fa19688fce tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:56.725684 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f7ba3ba8-f068-4572-b085-17fa19688fce tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:56.726611 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f7ba3ba8-f068-4572-b085-17fa19688fce tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:56.727839 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f7ba3ba8-f068-4572-b085-17fa19688fce tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:56.734231 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f7ba3ba8-f068-4572-b085-17fa19688fce tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:56.735045 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f7ba3ba8-f068-4572-b085-17fa19688fce tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:57.023711 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-17caeb6b-509f-441e-8e79-7136fd27675e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:57.050697 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-17caeb6b-509f-441e-8e79-7136fd27675e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1708 microversion: 2.1 time: 1.211772 Sep 01 16:38:57.066101 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 212/396] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:55 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1708 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:57.078670 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-da027a15-65b9-4dd8-bf24-d705e1b842e6 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:57.079297 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-da027a15-65b9-4dd8-bf24-d705e1b842e6 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:57.099154 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-da027a15-65b9-4dd8-bf24-d705e1b842e6 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:57.099481 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-da027a15-65b9-4dd8-bf24-d705e1b842e6 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:57.100126 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-da027a15-65b9-4dd8-bf24-d705e1b842e6 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:57.101048 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-da027a15-65b9-4dd8-bf24-d705e1b842e6 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:57.105597 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-da027a15-65b9-4dd8-bf24-d705e1b842e6 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:57.106743 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-da027a15-65b9-4dd8-bf24-d705e1b842e6 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:57.744989 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f7ba3ba8-f068-4572-b085-17fa19688fce tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:57.757402 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f7ba3ba8-f068-4572-b085-17fa19688fce tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629" status: 200 len: 1367 microversion: 2.1 time: 1.080234 Sep 01 16:38:57.759417 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 185/397] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:56 2022] GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629 => generated 1367 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:57.772262 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8730cd10-4168-4026-8e22-4d0bc4b3a9a1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:57.775244 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8730cd10-4168-4026-8e22-4d0bc4b3a9a1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:57.791915 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8730cd10-4168-4026-8e22-4d0bc4b3a9a1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:57.792761 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8730cd10-4168-4026-8e22-4d0bc4b3a9a1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:57.793960 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8730cd10-4168-4026-8e22-4d0bc4b3a9a1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:57.796595 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8730cd10-4168-4026-8e22-4d0bc4b3a9a1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:57.797363 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8730cd10-4168-4026-8e22-4d0bc4b3a9a1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:57.799500 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8730cd10-4168-4026-8e22-4d0bc4b3a9a1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:58.343193 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-da027a15-65b9-4dd8-bf24-d705e1b842e6 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:58.352102 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-da027a15-65b9-4dd8-bf24-d705e1b842e6 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 200 len: 1371 microversion: 2.1 time: 1.293109 Sep 01 16:38:58.352681 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 213/398] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:57 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 1371 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:58.370189 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-727d1aff-e3ac-4ba0-a4f5-cf9f43b23858 req-c343d44a-8c9d-4cc8-a556-1e38d3783451 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca59565d-e140-4bf0-9ef3-9cc18f4d3068", "tag": "c9213b9e-d8d2-4cdc-b268-1f9f700f72ec"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:58.391380 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-727d1aff-e3ac-4ba0-a4f5-cf9f43b23858 req-c343d44a-8c9d-4cc8-a556-1e38d3783451 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:58.392721 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-727d1aff-e3ac-4ba0-a4f5-cf9f43b23858 req-c343d44a-8c9d-4cc8-a556-1e38d3783451 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:58.396700 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-727d1aff-e3ac-4ba0-a4f5-cf9f43b23858 req-c343d44a-8c9d-4cc8-a556-1e38d3783451 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:58.420547 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-727d1aff-e3ac-4ba0-a4f5-cf9f43b23858 req-c343d44a-8c9d-4cc8-a556-1e38d3783451 service nova] Creating event network-changed:c9213b9e-d8d2-4cdc-b268-1f9f700f72ec for instance ca59565d-e140-4bf0-9ef3-9cc18f4d3068 on hv-cinder-85221 Sep 01 16:38:58.428871 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-727d1aff-e3ac-4ba0-a4f5-cf9f43b23858 req-c343d44a-8c9d-4cc8-a556-1e38d3783451 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073379 Sep 01 16:38:58.449855 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 214/399] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:38:58.475869 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d845ebe7-7da3-48cd-b602-4f6c2366a852 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:58.489355 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d845ebe7-7da3-48cd-b602-4f6c2366a852 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:58.503595 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8730cd10-4168-4026-8e22-4d0bc4b3a9a1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:58.519024 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d845ebe7-7da3-48cd-b602-4f6c2366a852 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:58.530241 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d845ebe7-7da3-48cd-b602-4f6c2366a852 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:58.539706 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d845ebe7-7da3-48cd-b602-4f6c2366a852 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:58.540906 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d845ebe7-7da3-48cd-b602-4f6c2366a852 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:58.541763 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d845ebe7-7da3-48cd-b602-4f6c2366a852 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:58.542768 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d845ebe7-7da3-48cd-b602-4f6c2366a852 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:58.548708 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8730cd10-4168-4026-8e22-4d0bc4b3a9a1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:58.552423 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8730cd10-4168-4026-8e22-4d0bc4b3a9a1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:58.565598 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8730cd10-4168-4026-8e22-4d0bc4b3a9a1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1741 microversion: 2.20 time: 0.794043 Sep 01 16:38:58.570426 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 186/400] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:57 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1741 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:58.591953 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-9592a016-3bca-4eca-bcb5-96a57807d698 req-1204e2ac-3854-4d3d-b6a8-50da5f52a1e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f85533a0-bc5b-465a-895d-a473efbb0859", "tag": "dd7294aa-e60e-425e-98a5-e2158ff841de"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:58.645419 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-9592a016-3bca-4eca-bcb5-96a57807d698 req-1204e2ac-3854-4d3d-b6a8-50da5f52a1e9 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:58.646208 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-9592a016-3bca-4eca-bcb5-96a57807d698 req-1204e2ac-3854-4d3d-b6a8-50da5f52a1e9 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:58.646892 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-9592a016-3bca-4eca-bcb5-96a57807d698 req-1204e2ac-3854-4d3d-b6a8-50da5f52a1e9 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:58.709000 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-9592a016-3bca-4eca-bcb5-96a57807d698 req-1204e2ac-3854-4d3d-b6a8-50da5f52a1e9 service nova] Creating event network-changed:dd7294aa-e60e-425e-98a5-e2158ff841de for instance f85533a0-bc5b-465a-895d-a473efbb0859 on hv-cinder-85221 Sep 01 16:38:58.726190 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-9592a016-3bca-4eca-bcb5-96a57807d698 req-1204e2ac-3854-4d3d-b6a8-50da5f52a1e9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153360 Sep 01 16:38:58.727914 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 187/401] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:38:58.781763 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7446c7ea-8c8b-4e6a-b09c-d52be0ec254f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:58.783343 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7446c7ea-8c8b-4e6a-b09c-d52be0ec254f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: c22c916b-390e-4bfe-8529-695bac5e5629] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:58.794836 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7446c7ea-8c8b-4e6a-b09c-d52be0ec254f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:58.799772 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7446c7ea-8c8b-4e6a-b09c-d52be0ec254f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:58.805444 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7446c7ea-8c8b-4e6a-b09c-d52be0ec254f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:58.806558 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7446c7ea-8c8b-4e6a-b09c-d52be0ec254f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:58.807248 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7446c7ea-8c8b-4e6a-b09c-d52be0ec254f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:58.808187 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7446c7ea-8c8b-4e6a-b09c-d52be0ec254f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:59.485897 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d845ebe7-7da3-48cd-b602-4f6c2366a852 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:59.498711 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d845ebe7-7da3-48cd-b602-4f6c2366a852 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1708 microversion: 2.1 time: 1.039748 Sep 01 16:38:59.501586 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 215/402] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:58 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1708 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:59.525121 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-dea141e3-d046-495e-a800-f7023755531f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:59.530879 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-dea141e3-d046-495e-a800-f7023755531f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:59.555500 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dea141e3-d046-495e-a800-f7023755531f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:59.556251 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dea141e3-d046-495e-a800-f7023755531f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:59.556893 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dea141e3-d046-495e-a800-f7023755531f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:59.557773 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dea141e3-d046-495e-a800-f7023755531f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:59.558397 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dea141e3-d046-495e-a800-f7023755531f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:59.558980 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dea141e3-d046-495e-a800-f7023755531f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:59.660193 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7446c7ea-8c8b-4e6a-b09c-d52be0ec254f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:59.669835 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7446c7ea-8c8b-4e6a-b09c-d52be0ec254f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629" status: 200 len: 1367 microversion: 2.1 time: 0.892002 Sep 01 16:38:59.670758 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 188/403] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:58 2022] GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629 => generated 1367 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:59.681137 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2aff5d98-95c9-487e-b093-2e1ae697ea03 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:59.682026 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-2aff5d98-95c9-487e-b093-2e1ae697ea03 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:59.706634 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2aff5d98-95c9-487e-b093-2e1ae697ea03 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:59.707595 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2aff5d98-95c9-487e-b093-2e1ae697ea03 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:59.708232 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2aff5d98-95c9-487e-b093-2e1ae697ea03 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:59.709910 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2aff5d98-95c9-487e-b093-2e1ae697ea03 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:59.710740 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2aff5d98-95c9-487e-b093-2e1ae697ea03 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:59.711349 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2aff5d98-95c9-487e-b093-2e1ae697ea03 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:59.760694 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=4 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:59.764630 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=14 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:00.179089 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=10 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:00.261778 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-dea141e3-d046-495e-a800-f7023755531f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:00.290234 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2aff5d98-95c9-487e-b093-2e1ae697ea03 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:00.292829 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=100 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:00.295992 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-dea141e3-d046-495e-a800-f7023755531f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 200 len: 1371 microversion: 2.1 time: 0.792954 Sep 01 16:39:00.296718 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 216/404] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:59 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 1371 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:00.302456 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2aff5d98-95c9-487e-b093-2e1ae697ea03 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:00.304213 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2aff5d98-95c9-487e-b093-2e1ae697ea03 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:00.305741 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2aff5d98-95c9-487e-b093-2e1ae697ea03 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1741 microversion: 2.20 time: 0.633648 Sep 01 16:39:00.320627 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 189/405] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:59 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1741 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:39:00.520087 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c301ec00-5a01-4d23-aa0a-d840342004db tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:00.520691 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-c301ec00-5a01-4d23-aa0a-d840342004db tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:00.531124 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c301ec00-5a01-4d23-aa0a-d840342004db tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:00.531618 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c301ec00-5a01-4d23-aa0a-d840342004db tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:00.535846 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c301ec00-5a01-4d23-aa0a-d840342004db tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:00.536987 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c301ec00-5a01-4d23-aa0a-d840342004db tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:00.537628 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c301ec00-5a01-4d23-aa0a-d840342004db tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:00.538287 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c301ec00-5a01-4d23-aa0a-d840342004db tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:00.702490 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-51afe714-11b4-4636-893f-a6d97209e658 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:00.703181 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-51afe714-11b4-4636-893f-a6d97209e658 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: c22c916b-390e-4bfe-8529-695bac5e5629] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:00.724206 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-51afe714-11b4-4636-893f-a6d97209e658 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:00.724645 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-51afe714-11b4-4636-893f-a6d97209e658 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:00.725203 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-51afe714-11b4-4636-893f-a6d97209e658 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:00.725896 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-51afe714-11b4-4636-893f-a6d97209e658 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:00.726502 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-51afe714-11b4-4636-893f-a6d97209e658 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:00.726953 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-51afe714-11b4-4636-893f-a6d97209e658 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:01.245285 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-51afe714-11b4-4636-893f-a6d97209e658 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:01.252401 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c301ec00-5a01-4d23-aa0a-d840342004db tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:01.265935 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-c301ec00-5a01-4d23-aa0a-d840342004db tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1708 microversion: 2.1 time: 0.748301 Sep 01 16:39:01.278511 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 217/406] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:00 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1708 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:01.292319 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-51afe714-11b4-4636-893f-a6d97209e658 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629" status: 200 len: 1367 microversion: 2.1 time: 0.578954 Sep 01 16:39:01.300236 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 190/407] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:00 2022] GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629 => generated 1367 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:39:01.336144 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e5605cfc-ea78-4763-be24-0d9819c2f22e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:01.337398 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e5605cfc-ea78-4763-be24-0d9819c2f22e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:01.347081 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c5de0fa1-a17d-409e-a96d-bbb1d539a04c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:01.352388 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c5de0fa1-a17d-409e-a96d-bbb1d539a04c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:01.363440 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e5605cfc-ea78-4763-be24-0d9819c2f22e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:01.363972 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e5605cfc-ea78-4763-be24-0d9819c2f22e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:01.364408 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e5605cfc-ea78-4763-be24-0d9819c2f22e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:01.365121 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e5605cfc-ea78-4763-be24-0d9819c2f22e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:01.372836 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e5605cfc-ea78-4763-be24-0d9819c2f22e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:01.374061 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e5605cfc-ea78-4763-be24-0d9819c2f22e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:01.374591 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c5de0fa1-a17d-409e-a96d-bbb1d539a04c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:01.378251 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c5de0fa1-a17d-409e-a96d-bbb1d539a04c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:01.378860 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c5de0fa1-a17d-409e-a96d-bbb1d539a04c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:01.379763 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c5de0fa1-a17d-409e-a96d-bbb1d539a04c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:01.380254 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c5de0fa1-a17d-409e-a96d-bbb1d539a04c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:01.380678 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c5de0fa1-a17d-409e-a96d-bbb1d539a04c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:01.728774 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c5de0fa1-a17d-409e-a96d-bbb1d539a04c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:01.737146 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-e5605cfc-ea78-4763-be24-0d9819c2f22e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:01.754988 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c5de0fa1-a17d-409e-a96d-bbb1d539a04c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:01.766806 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e5605cfc-ea78-4763-be24-0d9819c2f22e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 200 len: 1371 microversion: 2.1 time: 0.447196 Sep 01 16:39:01.774702 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 218/408] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:01 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 1371 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:01.774892 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c5de0fa1-a17d-409e-a96d-bbb1d539a04c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:01.774892 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c5de0fa1-a17d-409e-a96d-bbb1d539a04c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1741 microversion: 2.20 time: 0.442682 Sep 01 16:39:01.774892 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 191/409] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:01 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1741 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:39:01.779168 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-f5d4033e-fd56-44a4-9cce-89a19e53652b req-b7f7f32e-e6a0-4202-8078-ab2fa18465aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c22c916b-390e-4bfe-8529-695bac5e5629", "tag": "80b3e074-a837-4fc6-943a-2a3be4791735"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:01.793364 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-f5d4033e-fd56-44a4-9cce-89a19e53652b req-b7f7f32e-e6a0-4202-8078-ab2fa18465aa service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:01.794195 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-f5d4033e-fd56-44a4-9cce-89a19e53652b req-b7f7f32e-e6a0-4202-8078-ab2fa18465aa service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:01.794672 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-f5d4033e-fd56-44a4-9cce-89a19e53652b req-b7f7f32e-e6a0-4202-8078-ab2fa18465aa service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:01.810572 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-f5d4033e-fd56-44a4-9cce-89a19e53652b req-b7f7f32e-e6a0-4202-8078-ab2fa18465aa service nova] Creating event network-changed:80b3e074-a837-4fc6-943a-2a3be4791735 for instance c22c916b-390e-4bfe-8529-695bac5e5629 on hv-cinder-85221 Sep 01 16:39:01.818285 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-f5d4033e-fd56-44a4-9cce-89a19e53652b req-b7f7f32e-e6a0-4202-8078-ab2fa18465aa service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049377 Sep 01 16:39:01.820224 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 219/410] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:39:02.316545 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-60c45560-8b17-4c7d-81bd-39d6b1e912a4 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:02.317347 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-60c45560-8b17-4c7d-81bd-39d6b1e912a4 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: c22c916b-390e-4bfe-8529-695bac5e5629] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:02.321119 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-75de02e1-99dc-47b7-928e-ae4729704019 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:02.322093 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-75de02e1-99dc-47b7-928e-ae4729704019 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:02.330678 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-60c45560-8b17-4c7d-81bd-39d6b1e912a4 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:02.332812 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-60c45560-8b17-4c7d-81bd-39d6b1e912a4 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:02.334594 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-60c45560-8b17-4c7d-81bd-39d6b1e912a4 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:02.336162 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-60c45560-8b17-4c7d-81bd-39d6b1e912a4 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:02.336802 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-60c45560-8b17-4c7d-81bd-39d6b1e912a4 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:02.337345 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-60c45560-8b17-4c7d-81bd-39d6b1e912a4 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:02.338199 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-75de02e1-99dc-47b7-928e-ae4729704019 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:02.338703 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-75de02e1-99dc-47b7-928e-ae4729704019 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:02.339142 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-75de02e1-99dc-47b7-928e-ae4729704019 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:02.339864 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-75de02e1-99dc-47b7-928e-ae4729704019 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:02.340362 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-75de02e1-99dc-47b7-928e-ae4729704019 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:02.340775 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-75de02e1-99dc-47b7-928e-ae4729704019 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:02.759305 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-75de02e1-99dc-47b7-928e-ae4729704019 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:02.774737 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-75de02e1-99dc-47b7-928e-ae4729704019 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1712 microversion: 2.1 time: 0.459536 Sep 01 16:39:02.775257 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 220/411] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:02 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1712 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:39:02.803598 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b7eb0887-931d-438c-a523-2e5f5b1dc8f5 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:02.807165 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-b7eb0887-931d-438c-a523-2e5f5b1dc8f5 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:02.826316 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b7eb0887-931d-438c-a523-2e5f5b1dc8f5 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:02.827469 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b7eb0887-931d-438c-a523-2e5f5b1dc8f5 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:02.828133 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b7eb0887-931d-438c-a523-2e5f5b1dc8f5 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:02.828999 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b7eb0887-931d-438c-a523-2e5f5b1dc8f5 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:02.830552 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b7eb0887-931d-438c-a523-2e5f5b1dc8f5 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:02.831167 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b7eb0887-931d-438c-a523-2e5f5b1dc8f5 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:02.910808 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-60c45560-8b17-4c7d-81bd-39d6b1e912a4 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:02.922951 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-60c45560-8b17-4c7d-81bd-39d6b1e912a4 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629" status: 200 len: 1367 microversion: 2.1 time: 0.612039 Sep 01 16:39:02.952737 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 192/412] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:02 2022] GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629 => generated 1367 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:02.964287 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0f751956-10d1-424d-b933-5b880dcf6284 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:02.966645 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0f751956-10d1-424d-b933-5b880dcf6284 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:02.986281 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f751956-10d1-424d-b933-5b880dcf6284 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:02.987009 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f751956-10d1-424d-b933-5b880dcf6284 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:02.987667 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f751956-10d1-424d-b933-5b880dcf6284 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:02.988775 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f751956-10d1-424d-b933-5b880dcf6284 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:02.989576 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f751956-10d1-424d-b933-5b880dcf6284 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:02.990426 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f751956-10d1-424d-b933-5b880dcf6284 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:03.316646 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b7eb0887-931d-438c-a523-2e5f5b1dc8f5 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:03.337612 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-b7eb0887-931d-438c-a523-2e5f5b1dc8f5 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 200 len: 1371 microversion: 2.1 time: 0.544051 Sep 01 16:39:03.338684 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 221/413] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:02 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 1371 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:39:03.389921 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0f751956-10d1-424d-b933-5b880dcf6284 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:03.408236 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0f751956-10d1-424d-b933-5b880dcf6284 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:03.410204 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0f751956-10d1-424d-b933-5b880dcf6284 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:03.413004 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0f751956-10d1-424d-b933-5b880dcf6284 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1741 microversion: 2.20 time: 0.458585 Sep 01 16:39:03.417748 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 193/414] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:02 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1741 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:39:03.970855 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-890bd43a-3677-4ad4-86ab-f499ef530f3e tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:03.972139 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-890bd43a-3677-4ad4-86ab-f499ef530f3e tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: c22c916b-390e-4bfe-8529-695bac5e5629] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:03.978677 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-890bd43a-3677-4ad4-86ab-f499ef530f3e tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:03.979594 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-890bd43a-3677-4ad4-86ab-f499ef530f3e tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:03.980065 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-890bd43a-3677-4ad4-86ab-f499ef530f3e tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:03.980798 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-890bd43a-3677-4ad4-86ab-f499ef530f3e tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:03.981442 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-890bd43a-3677-4ad4-86ab-f499ef530f3e tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:03.981442 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-890bd43a-3677-4ad4-86ab-f499ef530f3e tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:03.999906 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:04.204146 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-890bd43a-3677-4ad4-86ab-f499ef530f3e tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:04.222793 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-890bd43a-3677-4ad4-86ab-f499ef530f3e tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629" status: 200 len: 1367 microversion: 2.1 time: 0.259000 Sep 01 16:39:04.223332 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 222/415] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:03 2022] GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629 => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:04.360705 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-19bdd8ec-862f-456f-bbe4-c390dd2d3357 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:04.362261 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-19bdd8ec-862f-456f-bbe4-c390dd2d3357 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:04.382059 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-19bdd8ec-862f-456f-bbe4-c390dd2d3357 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:04.382650 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-19bdd8ec-862f-456f-bbe4-c390dd2d3357 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:04.383035 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-19bdd8ec-862f-456f-bbe4-c390dd2d3357 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:04.383988 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-19bdd8ec-862f-456f-bbe4-c390dd2d3357 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:04.385300 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-19bdd8ec-862f-456f-bbe4-c390dd2d3357 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:04.387924 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-19bdd8ec-862f-456f-bbe4-c390dd2d3357 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:04.445877 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e9c5b3de-03e0-49b2-9d58-ed26d5c3836b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:04.447086 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e9c5b3de-03e0-49b2-9d58-ed26d5c3836b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:04.456104 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e9c5b3de-03e0-49b2-9d58-ed26d5c3836b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:04.456854 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e9c5b3de-03e0-49b2-9d58-ed26d5c3836b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:04.457535 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e9c5b3de-03e0-49b2-9d58-ed26d5c3836b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:04.458613 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e9c5b3de-03e0-49b2-9d58-ed26d5c3836b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:04.459314 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e9c5b3de-03e0-49b2-9d58-ed26d5c3836b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:04.460098 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e9c5b3de-03e0-49b2-9d58-ed26d5c3836b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:04.716096 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-19bdd8ec-862f-456f-bbe4-c390dd2d3357 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:04.725109 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-19bdd8ec-862f-456f-bbe4-c390dd2d3357 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 200 len: 1371 microversion: 2.1 time: 0.369879 Sep 01 16:39:04.725812 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 194/416] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:04 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 1371 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:04.771361 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-e9c5b3de-03e0-49b2-9d58-ed26d5c3836b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:04.787974 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-e9c5b3de-03e0-49b2-9d58-ed26d5c3836b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:04.792486 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-e9c5b3de-03e0-49b2-9d58-ed26d5c3836b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:04.795449 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e9c5b3de-03e0-49b2-9d58-ed26d5c3836b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1741 microversion: 2.20 time: 0.360090 Sep 01 16:39:04.799850 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 223/417] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:04 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1741 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:39:05.246034 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9234eccf-32b9-4f7d-ae2e-3b4245e2c58c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:05.246877 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9234eccf-32b9-4f7d-ae2e-3b4245e2c58c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: c22c916b-390e-4bfe-8529-695bac5e5629] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:05.256214 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9234eccf-32b9-4f7d-ae2e-3b4245e2c58c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:05.256708 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9234eccf-32b9-4f7d-ae2e-3b4245e2c58c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:05.257140 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9234eccf-32b9-4f7d-ae2e-3b4245e2c58c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:05.257878 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9234eccf-32b9-4f7d-ae2e-3b4245e2c58c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:05.258333 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9234eccf-32b9-4f7d-ae2e-3b4245e2c58c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:05.258755 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9234eccf-32b9-4f7d-ae2e-3b4245e2c58c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:05.575561 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-2fd903a1-5daf-4efa-b370-f3931ff6273e req-9a451aa2-e83d-4084-ba7f-e9d89e476f21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f85533a0-bc5b-465a-895d-a473efbb0859", "name": "network-vif-plugged", "status": "completed", "tag": "dd7294aa-e60e-425e-98a5-e2158ff841de"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:05.588494 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-2fd903a1-5daf-4efa-b370-f3931ff6273e req-9a451aa2-e83d-4084-ba7f-e9d89e476f21 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:05.588973 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-2fd903a1-5daf-4efa-b370-f3931ff6273e req-9a451aa2-e83d-4084-ba7f-e9d89e476f21 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:05.589395 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-2fd903a1-5daf-4efa-b370-f3931ff6273e req-9a451aa2-e83d-4084-ba7f-e9d89e476f21 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:05.603538 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-2fd903a1-5daf-4efa-b370-f3931ff6273e req-9a451aa2-e83d-4084-ba7f-e9d89e476f21 service nova] Creating event network-vif-plugged:dd7294aa-e60e-425e-98a5-e2158ff841de for instance f85533a0-bc5b-465a-895d-a473efbb0859 on hv-cinder-85221 Sep 01 16:39:05.609970 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-2fd903a1-5daf-4efa-b370-f3931ff6273e req-9a451aa2-e83d-4084-ba7f-e9d89e476f21 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038768 Sep 01 16:39:05.610958 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 224/418] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:39:05.766369 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7738e368-3146-4166-b7d0-44a15edbee33 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:05.767139 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-7738e368-3146-4166-b7d0-44a15edbee33 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:05.775312 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7738e368-3146-4166-b7d0-44a15edbee33 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:05.775807 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7738e368-3146-4166-b7d0-44a15edbee33 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:05.776279 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7738e368-3146-4166-b7d0-44a15edbee33 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:05.776988 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7738e368-3146-4166-b7d0-44a15edbee33 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:05.777449 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7738e368-3146-4166-b7d0-44a15edbee33 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:05.777989 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7738e368-3146-4166-b7d0-44a15edbee33 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:05.872976 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9234eccf-32b9-4f7d-ae2e-3b4245e2c58c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:05.886894 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9234eccf-32b9-4f7d-ae2e-3b4245e2c58c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629" status: 200 len: 1367 microversion: 2.1 time: 0.643824 Sep 01 16:39:05.886894 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 195/419] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:05 2022] GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629 => generated 1367 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:05.893224 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-546f6d64-b6c3-4a1f-ba01-ce7bf19f7f2b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:05.894003 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-546f6d64-b6c3-4a1f-ba01-ce7bf19f7f2b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:05.901335 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-546f6d64-b6c3-4a1f-ba01-ce7bf19f7f2b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:05.901927 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-546f6d64-b6c3-4a1f-ba01-ce7bf19f7f2b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:05.902513 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-546f6d64-b6c3-4a1f-ba01-ce7bf19f7f2b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:05.903506 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-546f6d64-b6c3-4a1f-ba01-ce7bf19f7f2b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:05.904095 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-546f6d64-b6c3-4a1f-ba01-ce7bf19f7f2b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:05.904598 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-546f6d64-b6c3-4a1f-ba01-ce7bf19f7f2b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:06.135976 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-7738e368-3146-4166-b7d0-44a15edbee33 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:06.143915 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-7738e368-3146-4166-b7d0-44a15edbee33 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 200 len: 1371 microversion: 2.1 time: 0.387758 Sep 01 16:39:06.144532 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 225/420] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:05 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 1371 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:06.149107 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-dc854d76-9166-431d-9fa0-b7b104f9c3aa tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1423570533", "imageRef": "49e5276c-002c-454f-8be8-76deb18b6b28", "flavorRef": "452", "networks": [{"uuid": "9987aed2-04e9-4e4c-b85b-273e7e9ceb19"}]}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:06.179824 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-546f6d64-b6c3-4a1f-ba01-ce7bf19f7f2b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:06.188843 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-546f6d64-b6c3-4a1f-ba01-ce7bf19f7f2b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:06.190394 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-546f6d64-b6c3-4a1f-ba01-ce7bf19f7f2b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:06.191610 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-546f6d64-b6c3-4a1f-ba01-ce7bf19f7f2b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1723 microversion: 2.20 time: 0.305796 Sep 01 16:39:06.192319 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 196/421] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:05 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1723 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:39:06.204615 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.network.neutron [None req-dc854d76-9166-431d-9fa0-b7b104f9c3aa tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] validate_networks() for [('9987aed2-04e9-4e4c-b85b-273e7e9ceb19', None, None, None, None, None)] {{(pid=127199) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:39:06.666877 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-dc854d76-9166-431d-9fa0-b7b104f9c3aa tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Flavor limits 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:39:06.667481 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-dc854d76-9166-431d-9fa0-b7b104f9c3aa tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Image limits 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:39:06.667917 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-dc854d76-9166-431d-9fa0-b7b104f9c3aa tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Flavor pref 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:39:06.668426 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-dc854d76-9166-431d-9fa0-b7b104f9c3aa tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Image pref 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:39:06.668830 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-dc854d76-9166-431d-9fa0-b7b104f9c3aa tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:39:06.679164 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dc854d76-9166-431d-9fa0-b7b104f9c3aa tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:06.679629 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dc854d76-9166-431d-9fa0-b7b104f9c3aa tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:06.680088 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dc854d76-9166-431d-9fa0-b7b104f9c3aa tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:06.680861 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dc854d76-9166-431d-9fa0-b7b104f9c3aa tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:06.681302 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dc854d76-9166-431d-9fa0-b7b104f9c3aa tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:06.681714 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dc854d76-9166-431d-9fa0-b7b104f9c3aa tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:06.699743 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-dc854d76-9166-431d-9fa0-b7b104f9c3aa tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Getting quotas for project d23aee15763f4997a71fa7e6864aa4a3. Resources: {'ram', 'cores', 'instances'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:39:06.704294 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-dc854d76-9166-431d-9fa0-b7b104f9c3aa tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Getting quotas for user 94fa5cd826e24f3992b537e56dc4e1da and project d23aee15763f4997a71fa7e6864aa4a3. Resources: {'ram', 'cores', 'instances'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:39:06.716070 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-dc854d76-9166-431d-9fa0-b7b104f9c3aa tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Going to run 1 instances... {{(pid=127199) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:39:06.718827 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-dc854d76-9166-431d-9fa0-b7b104f9c3aa tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 06e1b974-c011-46e9-92bf-1c64c1e07f2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='49e5276c-002c-454f-8be8-76deb18b6b28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:39:06.780709 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-dc854d76-9166-431d-9fa0-b7b104f9c3aa tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.635071 Sep 01 16:39:06.781356 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 226/422] 10.222.0.62 () {60 vars in 1147 bytes} [Thu Sep 1 16:39:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:39:06.791940 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-658dff0f-d7d5-4cfa-adb6-88e55674a636 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:06.792587 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-658dff0f-d7d5-4cfa-adb6-88e55674a636 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 06e1b974-c011-46e9-92bf-1c64c1e07f2e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:06.853632 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-658dff0f-d7d5-4cfa-adb6-88e55674a636 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fa5cd826e24f3992b537e56dc4e1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23aee15763f4997a71fa7e6864aa4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:06.861397 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-658dff0f-d7d5-4cfa-adb6-88e55674a636 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e" status: 200 len: 1214 microversion: 2.1 time: 0.073128 Sep 01 16:39:06.861973 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 197/423] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:06 2022] GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:06.907003 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-07b44c59-576f-4c4b-8f1e-96bc8baa37f2 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:06.907611 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-07b44c59-576f-4c4b-8f1e-96bc8baa37f2 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: c22c916b-390e-4bfe-8529-695bac5e5629] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:06.915230 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-07b44c59-576f-4c4b-8f1e-96bc8baa37f2 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:06.915648 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-07b44c59-576f-4c4b-8f1e-96bc8baa37f2 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:06.916111 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-07b44c59-576f-4c4b-8f1e-96bc8baa37f2 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:06.916867 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-07b44c59-576f-4c4b-8f1e-96bc8baa37f2 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:06.917256 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-07b44c59-576f-4c4b-8f1e-96bc8baa37f2 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:06.917685 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-07b44c59-576f-4c4b-8f1e-96bc8baa37f2 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:07.073975 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-07b44c59-576f-4c4b-8f1e-96bc8baa37f2 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:07.082710 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-07b44c59-576f-4c4b-8f1e-96bc8baa37f2 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629" status: 200 len: 1367 microversion: 2.1 time: 0.179895 Sep 01 16:39:07.083288 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 227/424] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:06 2022] GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:07.164584 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7d26769e-c27e-453b-9397-4efc645b275e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:07.165515 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7d26769e-c27e-453b-9397-4efc645b275e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:07.173960 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7d26769e-c27e-453b-9397-4efc645b275e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:07.174461 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7d26769e-c27e-453b-9397-4efc645b275e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:07.174899 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7d26769e-c27e-453b-9397-4efc645b275e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:07.175596 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7d26769e-c27e-453b-9397-4efc645b275e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:07.176082 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7d26769e-c27e-453b-9397-4efc645b275e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:07.176516 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7d26769e-c27e-453b-9397-4efc645b275e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:07.224420 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-47531771-87b6-43ee-92a9-39753c7987c7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:07.226046 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-47531771-87b6-43ee-92a9-39753c7987c7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:07.240388 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-47531771-87b6-43ee-92a9-39753c7987c7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:07.241809 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-47531771-87b6-43ee-92a9-39753c7987c7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:07.242557 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-47531771-87b6-43ee-92a9-39753c7987c7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:07.243502 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-47531771-87b6-43ee-92a9-39753c7987c7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:07.244115 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-47531771-87b6-43ee-92a9-39753c7987c7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:07.244982 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-47531771-87b6-43ee-92a9-39753c7987c7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:07.387460 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7d26769e-c27e-453b-9397-4efc645b275e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:07.396515 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7d26769e-c27e-453b-9397-4efc645b275e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 200 len: 1371 microversion: 2.1 time: 0.236134 Sep 01 16:39:07.397476 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 198/425] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:07 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 1371 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:07.419711 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-47531771-87b6-43ee-92a9-39753c7987c7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:07.428327 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-47531771-87b6-43ee-92a9-39753c7987c7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:07.429764 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-47531771-87b6-43ee-92a9-39753c7987c7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:07.430933 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-47531771-87b6-43ee-92a9-39753c7987c7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1723 microversion: 2.20 time: 0.216010 Sep 01 16:39:07.431500 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 228/426] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:07 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:39:07.883750 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5d4b556d-6746-494c-b2cd-e9bac760aea3 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:07.884394 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5d4b556d-6746-494c-b2cd-e9bac760aea3 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 06e1b974-c011-46e9-92bf-1c64c1e07f2e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:07.891731 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5d4b556d-6746-494c-b2cd-e9bac760aea3 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:07.892246 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5d4b556d-6746-494c-b2cd-e9bac760aea3 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:07.892677 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5d4b556d-6746-494c-b2cd-e9bac760aea3 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:07.893373 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5d4b556d-6746-494c-b2cd-e9bac760aea3 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:07.893822 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5d4b556d-6746-494c-b2cd-e9bac760aea3 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:07.894241 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5d4b556d-6746-494c-b2cd-e9bac760aea3 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:07.968927 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5d4b556d-6746-494c-b2cd-e9bac760aea3 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fa5cd826e24f3992b537e56dc4e1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23aee15763f4997a71fa7e6864aa4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:07.977874 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5d4b556d-6746-494c-b2cd-e9bac760aea3 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e" status: 200 len: 1218 microversion: 2.1 time: 0.097867 Sep 01 16:39:07.978470 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 199/427] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:07 2022] GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:08.103932 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-cec6497e-074b-465e-8748-43fdc30b3c57 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:08.104605 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-cec6497e-074b-465e-8748-43fdc30b3c57 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: c22c916b-390e-4bfe-8529-695bac5e5629] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:08.111328 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cec6497e-074b-465e-8748-43fdc30b3c57 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:08.111829 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cec6497e-074b-465e-8748-43fdc30b3c57 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:08.112301 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cec6497e-074b-465e-8748-43fdc30b3c57 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:08.113045 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cec6497e-074b-465e-8748-43fdc30b3c57 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:08.113489 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cec6497e-074b-465e-8748-43fdc30b3c57 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:08.113905 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cec6497e-074b-465e-8748-43fdc30b3c57 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:08.258184 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-cec6497e-074b-465e-8748-43fdc30b3c57 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:08.267766 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-cec6497e-074b-465e-8748-43fdc30b3c57 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629" status: 200 len: 1367 microversion: 2.1 time: 0.168061 Sep 01 16:39:08.268360 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 229/428] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:08 2022] GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:08.419071 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-81ae5b80-9285-4f73-ad08-f39bcb89fd25 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:08.420289 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-81ae5b80-9285-4f73-ad08-f39bcb89fd25 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:08.426351 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-81ae5b80-9285-4f73-ad08-f39bcb89fd25 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:08.426830 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-81ae5b80-9285-4f73-ad08-f39bcb89fd25 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:08.427258 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-81ae5b80-9285-4f73-ad08-f39bcb89fd25 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:08.427972 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-81ae5b80-9285-4f73-ad08-f39bcb89fd25 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:08.428428 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-81ae5b80-9285-4f73-ad08-f39bcb89fd25 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:08.428846 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-81ae5b80-9285-4f73-ad08-f39bcb89fd25 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:08.455166 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-bdb68c18-65ff-442f-979f-cdec01ce4245 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:08.455928 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-bdb68c18-65ff-442f-979f-cdec01ce4245 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:08.462609 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bdb68c18-65ff-442f-979f-cdec01ce4245 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:08.463080 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bdb68c18-65ff-442f-979f-cdec01ce4245 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:08.463506 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bdb68c18-65ff-442f-979f-cdec01ce4245 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:08.464244 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bdb68c18-65ff-442f-979f-cdec01ce4245 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:08.464683 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bdb68c18-65ff-442f-979f-cdec01ce4245 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:08.465116 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bdb68c18-65ff-442f-979f-cdec01ce4245 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:08.622547 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-81ae5b80-9285-4f73-ad08-f39bcb89fd25 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:08.630859 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-81ae5b80-9285-4f73-ad08-f39bcb89fd25 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 200 len: 1371 microversion: 2.1 time: 0.215797 Sep 01 16:39:08.631731 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 200/429] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:08 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 1371 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:08.662296 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-bdb68c18-65ff-442f-979f-cdec01ce4245 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:08.671399 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-bdb68c18-65ff-442f-979f-cdec01ce4245 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:08.673690 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-bdb68c18-65ff-442f-979f-cdec01ce4245 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:08.674022 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-bdb68c18-65ff-442f-979f-cdec01ce4245 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1723 microversion: 2.20 time: 0.223868 Sep 01 16:39:08.674861 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 230/430] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:08 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:39:09.001114 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ac3ae82d-3889-4ebc-8270-da463d9b347d tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:09.001774 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ac3ae82d-3889-4ebc-8270-da463d9b347d tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 06e1b974-c011-46e9-92bf-1c64c1e07f2e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:09.010936 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ac3ae82d-3889-4ebc-8270-da463d9b347d tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:09.011525 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ac3ae82d-3889-4ebc-8270-da463d9b347d tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:09.012197 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ac3ae82d-3889-4ebc-8270-da463d9b347d tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:09.013073 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ac3ae82d-3889-4ebc-8270-da463d9b347d tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:09.013512 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ac3ae82d-3889-4ebc-8270-da463d9b347d tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:09.013918 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ac3ae82d-3889-4ebc-8270-da463d9b347d tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:09.081249 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ac3ae82d-3889-4ebc-8270-da463d9b347d tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fa5cd826e24f3992b537e56dc4e1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23aee15763f4997a71fa7e6864aa4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:09.089461 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ac3ae82d-3889-4ebc-8270-da463d9b347d tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e" status: 200 len: 1266 microversion: 2.1 time: 0.092746 Sep 01 16:39:09.090039 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 201/431] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:08 2022] GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e => generated 1266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:09.293770 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-5f11491a-3942-47e4-9c5b-e6ff315eb5c9 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:09.294624 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-5f11491a-3942-47e4-9c5b-e6ff315eb5c9 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: c22c916b-390e-4bfe-8529-695bac5e5629] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:09.301470 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5f11491a-3942-47e4-9c5b-e6ff315eb5c9 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:09.301953 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5f11491a-3942-47e4-9c5b-e6ff315eb5c9 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:09.302381 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5f11491a-3942-47e4-9c5b-e6ff315eb5c9 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:09.303080 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5f11491a-3942-47e4-9c5b-e6ff315eb5c9 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:09.303523 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5f11491a-3942-47e4-9c5b-e6ff315eb5c9 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:09.303923 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5f11491a-3942-47e4-9c5b-e6ff315eb5c9 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:09.466186 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-5f11491a-3942-47e4-9c5b-e6ff315eb5c9 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:09.474520 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-5f11491a-3942-47e4-9c5b-e6ff315eb5c9 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629" status: 200 len: 1367 microversion: 2.1 time: 0.184637 Sep 01 16:39:09.475205 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 231/432] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:09 2022] GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:09.563623 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-db3dd5f6-79a9-4fbe-9ca1-9576c8f241d1 req-af30d8e6-59c5-4c3e-98d7-5307c0a17891 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c22c916b-390e-4bfe-8529-695bac5e5629", "name": "network-vif-plugged", "status": "completed", "tag": "80b3e074-a837-4fc6-943a-2a3be4791735"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:09.580130 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:09.585813 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-db3dd5f6-79a9-4fbe-9ca1-9576c8f241d1 req-af30d8e6-59c5-4c3e-98d7-5307c0a17891 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:09.586802 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-db3dd5f6-79a9-4fbe-9ca1-9576c8f241d1 req-af30d8e6-59c5-4c3e-98d7-5307c0a17891 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:09.587461 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-db3dd5f6-79a9-4fbe-9ca1-9576c8f241d1 req-af30d8e6-59c5-4c3e-98d7-5307c0a17891 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:09.612124 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-db3dd5f6-79a9-4fbe-9ca1-9576c8f241d1 req-af30d8e6-59c5-4c3e-98d7-5307c0a17891 service nova] Creating event network-vif-plugged:80b3e074-a837-4fc6-943a-2a3be4791735 for instance c22c916b-390e-4bfe-8529-695bac5e5629 on hv-cinder-85221 Sep 01 16:39:09.621932 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-db3dd5f6-79a9-4fbe-9ca1-9576c8f241d1 req-af30d8e6-59c5-4c3e-98d7-5307c0a17891 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063890 Sep 01 16:39:09.626612 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 202/433] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:39:09.663138 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-62c5c60c-91af-4703-b5ba-868f9bda3e69 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:09.664326 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-62c5c60c-91af-4703-b5ba-868f9bda3e69 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:09.674180 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-62c5c60c-91af-4703-b5ba-868f9bda3e69 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:09.674851 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-62c5c60c-91af-4703-b5ba-868f9bda3e69 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:09.675797 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-62c5c60c-91af-4703-b5ba-868f9bda3e69 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:09.676815 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-62c5c60c-91af-4703-b5ba-868f9bda3e69 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:09.677471 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-62c5c60c-91af-4703-b5ba-868f9bda3e69 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:09.678069 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-62c5c60c-91af-4703-b5ba-868f9bda3e69 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:09.698073 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-54d8667f-d6ba-4896-b3c9-35e8791b8b0f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:09.699038 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-54d8667f-d6ba-4896-b3c9-35e8791b8b0f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:09.718349 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-54d8667f-d6ba-4896-b3c9-35e8791b8b0f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:09.720567 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-54d8667f-d6ba-4896-b3c9-35e8791b8b0f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:09.721605 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-54d8667f-d6ba-4896-b3c9-35e8791b8b0f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:09.725375 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-54d8667f-d6ba-4896-b3c9-35e8791b8b0f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:09.728426 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-54d8667f-d6ba-4896-b3c9-35e8791b8b0f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:09.729486 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-54d8667f-d6ba-4896-b3c9-35e8791b8b0f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:09.949454 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-62c5c60c-91af-4703-b5ba-868f9bda3e69 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:09.960347 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-62c5c60c-91af-4703-b5ba-868f9bda3e69 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 200 len: 1565 microversion: 2.1 time: 0.308159 Sep 01 16:39:09.960994 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 232/434] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:09 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 1565 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:09.980208 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-54d8667f-d6ba-4896-b3c9-35e8791b8b0f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:09.986438 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a2b04182-8c03-44a3-b932-a89632ab0fed tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:09.986928 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-a2b04182-8c03-44a3-b932-a89632ab0fed tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:09.989643 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-54d8667f-d6ba-4896-b3c9-35e8791b8b0f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:09.991159 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-54d8667f-d6ba-4896-b3c9-35e8791b8b0f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:09.992467 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-54d8667f-d6ba-4896-b3c9-35e8791b8b0f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1726 microversion: 2.20 time: 0.298683 Sep 01 16:39:09.993093 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 203/435] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:09 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1726 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:39:09.993240 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a2b04182-8c03-44a3-b932-a89632ab0fed tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:09.993725 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a2b04182-8c03-44a3-b932-a89632ab0fed tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:09.994193 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a2b04182-8c03-44a3-b932-a89632ab0fed tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:09.994898 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a2b04182-8c03-44a3-b932-a89632ab0fed tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:09.995629 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a2b04182-8c03-44a3-b932-a89632ab0fed tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:09.996085 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a2b04182-8c03-44a3-b932-a89632ab0fed tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:10.016630 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-02223a64-f65a-4451-b0eb-ed14345d9dd1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea5a42f4-034a-423f-a942-d2e11eb85d91"}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:10.019168 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-02223a64-f65a-4451-b0eb-ed14345d9dd1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:10.026006 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-02223a64-f65a-4451-b0eb-ed14345d9dd1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:10.026478 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-02223a64-f65a-4451-b0eb-ed14345d9dd1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:10.027011 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-02223a64-f65a-4451-b0eb-ed14345d9dd1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:10.027598 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-02223a64-f65a-4451-b0eb-ed14345d9dd1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:10.028086 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-02223a64-f65a-4451-b0eb-ed14345d9dd1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:10.028555 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-02223a64-f65a-4451-b0eb-ed14345d9dd1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:10.090014 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-a2b04182-8c03-44a3-b932-a89632ab0fed tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107492 Sep 01 16:39:10.090704 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 233/436] 10.222.0.62 () {58 vars in 1275 bytes} [Thu Sep 1 16:39:09 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:39:10.111843 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-1848119e-d827-48b7-b3ab-df8882433bd7 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:10.112736 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-1848119e-d827-48b7-b3ab-df8882433bd7 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 06e1b974-c011-46e9-92bf-1c64c1e07f2e] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:10.119750 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1848119e-d827-48b7-b3ab-df8882433bd7 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:10.120614 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1848119e-d827-48b7-b3ab-df8882433bd7 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:10.121159 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1848119e-d827-48b7-b3ab-df8882433bd7 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:10.121880 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1848119e-d827-48b7-b3ab-df8882433bd7 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:10.122402 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1848119e-d827-48b7-b3ab-df8882433bd7 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:10.122849 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1848119e-d827-48b7-b3ab-df8882433bd7 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:10.302132 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-1848119e-d827-48b7-b3ab-df8882433bd7 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fa5cd826e24f3992b537e56dc4e1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23aee15763f4997a71fa7e6864aa4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:10.316371 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-1848119e-d827-48b7-b3ab-df8882433bd7 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e" status: 200 len: 1266 microversion: 2.1 time: 0.209172 Sep 01 16:39:10.317407 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 234/437] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:10 2022] GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:10.415595 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-02223a64-f65a-4451-b0eb-ed14345d9dd1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "POST /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.403177 Sep 01 16:39:10.416561 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 204/438] 10.222.0.62 () {62 vars in 1364 bytes} [Thu Sep 1 16:39:10 2022] POST /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a/os-volume_attachments => generated 188 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:39:10.495834 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-91b2e080-d7e9-4e24-801d-3251e3dabe17 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:10.496786 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-91b2e080-d7e9-4e24-801d-3251e3dabe17 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: c22c916b-390e-4bfe-8529-695bac5e5629] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:10.514873 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-91b2e080-d7e9-4e24-801d-3251e3dabe17 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:10.515724 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-91b2e080-d7e9-4e24-801d-3251e3dabe17 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:10.516172 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-91b2e080-d7e9-4e24-801d-3251e3dabe17 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:10.517071 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-91b2e080-d7e9-4e24-801d-3251e3dabe17 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:10.517529 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-91b2e080-d7e9-4e24-801d-3251e3dabe17 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:10.517944 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-91b2e080-d7e9-4e24-801d-3251e3dabe17 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:10.608351 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-443de363-59bc-45ad-a27c-8a898e90175e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:10.609281 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-443de363-59bc-45ad-a27c-8a898e90175e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:10.619665 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-443de363-59bc-45ad-a27c-8a898e90175e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:10.620288 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-443de363-59bc-45ad-a27c-8a898e90175e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:10.620761 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-443de363-59bc-45ad-a27c-8a898e90175e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:10.621567 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-443de363-59bc-45ad-a27c-8a898e90175e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:10.622092 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-443de363-59bc-45ad-a27c-8a898e90175e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:10.622644 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-443de363-59bc-45ad-a27c-8a898e90175e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:10.654159 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:10.723224 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-443de363-59bc-45ad-a27c-8a898e90175e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127198) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 01 16:39:10.800057 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-443de363-59bc-45ad-a27c-8a898e90175e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "POST /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a/action" status: 202 len: 0 microversion: 2.20 time: 0.197771 Sep 01 16:39:10.801139 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 205/439] 10.222.0.62 () {62 vars in 1319 bytes} [Thu Sep 1 16:39:10 2022] POST /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:39:10.811453 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e2734f05-c8c3-42aa-abd2-fff21e683b29 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:10.813121 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e2734f05-c8c3-42aa-abd2-fff21e683b29 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:10.819968 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e2734f05-c8c3-42aa-abd2-fff21e683b29 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:10.820465 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e2734f05-c8c3-42aa-abd2-fff21e683b29 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:10.820897 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e2734f05-c8c3-42aa-abd2-fff21e683b29 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:10.821802 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e2734f05-c8c3-42aa-abd2-fff21e683b29 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:10.822251 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e2734f05-c8c3-42aa-abd2-fff21e683b29 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:10.822838 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e2734f05-c8c3-42aa-abd2-fff21e683b29 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:10.943224 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-91b2e080-d7e9-4e24-801d-3251e3dabe17 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:10.952747 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-91b2e080-d7e9-4e24-801d-3251e3dabe17 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629" status: 200 len: 1367 microversion: 2.1 time: 0.460715 Sep 01 16:39:10.953924 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 235/440] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:10 2022] GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629 => generated 1367 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:11.223326 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e2734f05-c8c3-42aa-abd2-fff21e683b29 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:11.232969 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e2734f05-c8c3-42aa-abd2-fff21e683b29 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:11.234793 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e2734f05-c8c3-42aa-abd2-fff21e683b29 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:11.236046 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e2734f05-c8c3-42aa-abd2-fff21e683b29 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1752 microversion: 2.20 time: 0.429155 Sep 01 16:39:11.236621 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 206/441] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:10 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1752 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:39:11.339816 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e10547c2-c9e7-406a-80bb-150a539b1c3b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:11.340907 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e10547c2-c9e7-406a-80bb-150a539b1c3b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 06e1b974-c011-46e9-92bf-1c64c1e07f2e] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:11.352800 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e10547c2-c9e7-406a-80bb-150a539b1c3b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:11.353414 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e10547c2-c9e7-406a-80bb-150a539b1c3b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:11.353994 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e10547c2-c9e7-406a-80bb-150a539b1c3b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:11.354790 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e10547c2-c9e7-406a-80bb-150a539b1c3b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:11.355344 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e10547c2-c9e7-406a-80bb-150a539b1c3b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:11.355839 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e10547c2-c9e7-406a-80bb-150a539b1c3b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:11.600347 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-e10547c2-c9e7-406a-80bb-150a539b1c3b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fa5cd826e24f3992b537e56dc4e1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23aee15763f4997a71fa7e6864aa4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:11.609648 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e10547c2-c9e7-406a-80bb-150a539b1c3b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e" status: 200 len: 1272 microversion: 2.1 time: 0.275168 Sep 01 16:39:11.622016 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 236/442] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:11 2022] GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e => generated 1272 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:11.640430 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-bfd0fca0-362a-4d3a-83d0-6ee829dbd3c9 req-c3084930-fde7-4b30-942a-dfb4d9a86620 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ddc2614-8a62-4c61-a086-8dbab65e1f4a", "name": "network-vif-unplugged", "status": "completed", "tag": "9d73b218-5a3f-4e30-9685-717b1fbfe797"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:11.653754 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-bfd0fca0-362a-4d3a-83d0-6ee829dbd3c9 req-c3084930-fde7-4b30-942a-dfb4d9a86620 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:11.654622 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-bfd0fca0-362a-4d3a-83d0-6ee829dbd3c9 req-c3084930-fde7-4b30-942a-dfb4d9a86620 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:11.655515 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-bfd0fca0-362a-4d3a-83d0-6ee829dbd3c9 req-c3084930-fde7-4b30-942a-dfb4d9a86620 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:11.670443 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.compute.server_external_events [req-bfd0fca0-362a-4d3a-83d0-6ee829dbd3c9 req-c3084930-fde7-4b30-942a-dfb4d9a86620 service nova] Unable to find a host for instance 8ddc2614-8a62-4c61-a086-8dbab65e1f4a. Dropping event network-vif-unplugged {{(pid=127198) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 01 16:39:11.671666 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-bfd0fca0-362a-4d3a-83d0-6ee829dbd3c9 req-c3084930-fde7-4b30-942a-dfb4d9a86620 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035512 Sep 01 16:39:11.673211 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 207/443] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 01 16:39:11.977485 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-9eedbadc-0195-42f1-a8df-cf2f8088c541 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:11.978150 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-9eedbadc-0195-42f1-a8df-cf2f8088c541 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: c22c916b-390e-4bfe-8529-695bac5e5629] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:11.987770 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9eedbadc-0195-42f1-a8df-cf2f8088c541 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:11.988324 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9eedbadc-0195-42f1-a8df-cf2f8088c541 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:11.988769 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9eedbadc-0195-42f1-a8df-cf2f8088c541 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:11.989700 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9eedbadc-0195-42f1-a8df-cf2f8088c541 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:11.990164 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9eedbadc-0195-42f1-a8df-cf2f8088c541 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:11.990781 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9eedbadc-0195-42f1-a8df-cf2f8088c541 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:12.259857 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-dc375ddd-24f8-4d8b-b387-48e9d791c77f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:12.260485 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-dc375ddd-24f8-4d8b-b387-48e9d791c77f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:12.268371 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dc375ddd-24f8-4d8b-b387-48e9d791c77f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:12.268870 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dc375ddd-24f8-4d8b-b387-48e9d791c77f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:12.269298 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dc375ddd-24f8-4d8b-b387-48e9d791c77f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:12.270030 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dc375ddd-24f8-4d8b-b387-48e9d791c77f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:12.270487 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dc375ddd-24f8-4d8b-b387-48e9d791c77f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:12.270874 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dc375ddd-24f8-4d8b-b387-48e9d791c77f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:12.303608 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-9eedbadc-0195-42f1-a8df-cf2f8088c541 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:12.320811 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-9eedbadc-0195-42f1-a8df-cf2f8088c541 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629" status: 200 len: 1367 microversion: 2.1 time: 0.348735 Sep 01 16:39:12.321473 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 237/444] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:11 2022] GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629 => generated 1367 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:12.416404 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-7851dc53-51aa-4ddf-905c-249a13384e1f req-1ae2383a-1def-4b77-84ef-10deafe40069 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f85533a0-bc5b-465a-895d-a473efbb0859", "tag": "dd7294aa-e60e-425e-98a5-e2158ff841de"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:12.432016 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-7851dc53-51aa-4ddf-905c-249a13384e1f req-1ae2383a-1def-4b77-84ef-10deafe40069 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:12.432977 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-7851dc53-51aa-4ddf-905c-249a13384e1f req-1ae2383a-1def-4b77-84ef-10deafe40069 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:12.433800 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-7851dc53-51aa-4ddf-905c-249a13384e1f req-1ae2383a-1def-4b77-84ef-10deafe40069 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:12.463304 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-7851dc53-51aa-4ddf-905c-249a13384e1f req-1ae2383a-1def-4b77-84ef-10deafe40069 service nova] Creating event network-changed:dd7294aa-e60e-425e-98a5-e2158ff841de for instance f85533a0-bc5b-465a-895d-a473efbb0859 on hv-cinder-85221 Sep 01 16:39:12.473293 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-7851dc53-51aa-4ddf-905c-249a13384e1f req-1ae2383a-1def-4b77-84ef-10deafe40069 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061140 Sep 01 16:39:12.474421 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 238/445] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:39:12.594888 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-dc375ddd-24f8-4d8b-b387-48e9d791c77f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:12.606527 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-dc375ddd-24f8-4d8b-b387-48e9d791c77f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:12.608642 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-dc375ddd-24f8-4d8b-b387-48e9d791c77f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:12.610071 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-dc375ddd-24f8-4d8b-b387-48e9d791c77f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1752 microversion: 2.20 time: 0.354283 Sep 01 16:39:12.628151 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 208/446] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:12 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1752 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:39:12.633346 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e2e4d63b-c7d2-4885-b7fb-aff8d1bca798 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:12.634693 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e2e4d63b-c7d2-4885-b7fb-aff8d1bca798 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 06e1b974-c011-46e9-92bf-1c64c1e07f2e] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:12.643406 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e2e4d63b-c7d2-4885-b7fb-aff8d1bca798 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:12.644616 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e2e4d63b-c7d2-4885-b7fb-aff8d1bca798 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:12.645262 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e2e4d63b-c7d2-4885-b7fb-aff8d1bca798 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:12.646168 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e2e4d63b-c7d2-4885-b7fb-aff8d1bca798 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:12.646812 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e2e4d63b-c7d2-4885-b7fb-aff8d1bca798 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:12.648159 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e2e4d63b-c7d2-4885-b7fb-aff8d1bca798 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:13.004102 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-e2e4d63b-c7d2-4885-b7fb-aff8d1bca798 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fa5cd826e24f3992b537e56dc4e1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23aee15763f4997a71fa7e6864aa4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:13.014342 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e2e4d63b-c7d2-4885-b7fb-aff8d1bca798 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e" status: 200 len: 1314 microversion: 2.1 time: 0.385902 Sep 01 16:39:13.015154 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 239/447] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:12 2022] GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:39:13.344766 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-05895f45-b897-4319-8829-a0682afaa53d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:13.346131 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-05895f45-b897-4319-8829-a0682afaa53d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: c22c916b-390e-4bfe-8529-695bac5e5629] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:13.353943 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-05895f45-b897-4319-8829-a0682afaa53d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:13.357142 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-05895f45-b897-4319-8829-a0682afaa53d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:13.358956 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-05895f45-b897-4319-8829-a0682afaa53d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:13.359918 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-05895f45-b897-4319-8829-a0682afaa53d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:13.360622 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-05895f45-b897-4319-8829-a0682afaa53d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:13.361385 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-05895f45-b897-4319-8829-a0682afaa53d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:13.635016 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0b93af9c-a5c1-47d8-be73-af414cf4c736 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:13.636352 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-0b93af9c-a5c1-47d8-be73-af414cf4c736 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:13.646401 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0b93af9c-a5c1-47d8-be73-af414cf4c736 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:13.647400 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0b93af9c-a5c1-47d8-be73-af414cf4c736 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:13.648167 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0b93af9c-a5c1-47d8-be73-af414cf4c736 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:13.649932 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0b93af9c-a5c1-47d8-be73-af414cf4c736 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:13.650454 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0b93af9c-a5c1-47d8-be73-af414cf4c736 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:13.650890 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0b93af9c-a5c1-47d8-be73-af414cf4c736 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:13.768186 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-05895f45-b897-4319-8829-a0682afaa53d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:13.782238 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-05895f45-b897-4319-8829-a0682afaa53d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629" status: 200 len: 1558 microversion: 2.1 time: 0.442143 Sep 01 16:39:13.783975 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 209/448] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:13 2022] GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629 => generated 1558 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:13.806573 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e6031ea2-1a96-4827-af4b-0fa27e99da16 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:13.807669 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e6031ea2-1a96-4827-af4b-0fa27e99da16 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: c22c916b-390e-4bfe-8529-695bac5e5629] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:13.816311 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e6031ea2-1a96-4827-af4b-0fa27e99da16 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:13.816969 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e6031ea2-1a96-4827-af4b-0fa27e99da16 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:13.817530 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e6031ea2-1a96-4827-af4b-0fa27e99da16 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:13.818376 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e6031ea2-1a96-4827-af4b-0fa27e99da16 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:13.819391 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e6031ea2-1a96-4827-af4b-0fa27e99da16 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:13.820659 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e6031ea2-1a96-4827-af4b-0fa27e99da16 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:13.980489 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e6031ea2-1a96-4827-af4b-0fa27e99da16 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.178708 Sep 01 16:39:13.988651 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 210/449] 10.222.0.62 () {58 vars in 1275 bytes} [Thu Sep 1 16:39:13 2022] GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629/os-interface => generated 285 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:39:14.005268 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-0b93af9c-a5c1-47d8-be73-af414cf4c736 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:14.019925 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-0b93af9c-a5c1-47d8-be73-af414cf4c736 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:14.022361 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-0b93af9c-a5c1-47d8-be73-af414cf4c736 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:14.023642 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-0b93af9c-a5c1-47d8-be73-af414cf4c736 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1810 microversion: 2.20 time: 0.392931 Sep 01 16:39:14.024717 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 240/450] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:13 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1810 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:39:14.045889 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d79f4629-1743-4045-af65-ce7fe1677311 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:14.046772 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d79f4629-1743-4045-af65-ce7fe1677311 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 06e1b974-c011-46e9-92bf-1c64c1e07f2e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:14.057132 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d79f4629-1743-4045-af65-ce7fe1677311 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:14.057633 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d79f4629-1743-4045-af65-ce7fe1677311 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:14.058066 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d79f4629-1743-4045-af65-ce7fe1677311 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:14.058777 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d79f4629-1743-4045-af65-ce7fe1677311 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:14.059438 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d79f4629-1743-4045-af65-ce7fe1677311 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:14.060042 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d79f4629-1743-4045-af65-ce7fe1677311 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:14.254381 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d79f4629-1743-4045-af65-ce7fe1677311 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fa5cd826e24f3992b537e56dc4e1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23aee15763f4997a71fa7e6864aa4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:14.266130 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d79f4629-1743-4045-af65-ce7fe1677311 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e" status: 200 len: 1314 microversion: 2.1 time: 0.224600 Sep 01 16:39:14.266738 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 211/451] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:14 2022] GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:39:14.495848 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-3a63166b-d84f-4925-8e26-872c272b6123 req-de7ffe34-992f-4249-b6b1-85ab9598da16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06e1b974-c011-46e9-92bf-1c64c1e07f2e", "tag": "3a6d27f2-6a34-4a5a-b9d4-a058b540eda9"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:14.509333 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-3a63166b-d84f-4925-8e26-872c272b6123 req-de7ffe34-992f-4249-b6b1-85ab9598da16 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:14.510424 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-3a63166b-d84f-4925-8e26-872c272b6123 req-de7ffe34-992f-4249-b6b1-85ab9598da16 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:14.510922 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-3a63166b-d84f-4925-8e26-872c272b6123 req-de7ffe34-992f-4249-b6b1-85ab9598da16 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:14.526225 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-3a63166b-d84f-4925-8e26-872c272b6123 req-de7ffe34-992f-4249-b6b1-85ab9598da16 service nova] Creating event network-changed:3a6d27f2-6a34-4a5a-b9d4-a058b540eda9 for instance 06e1b974-c011-46e9-92bf-1c64c1e07f2e on hv-cinder-85221 Sep 01 16:39:14.533261 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-3a63166b-d84f-4925-8e26-872c272b6123 req-de7ffe34-992f-4249-b6b1-85ab9598da16 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041303 Sep 01 16:39:14.534890 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 241/452] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:39:15.051075 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-86d80f3e-8b95-42ea-9c24-34174c765332 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:15.052433 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-86d80f3e-8b95-42ea-9c24-34174c765332 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:15.067516 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-86d80f3e-8b95-42ea-9c24-34174c765332 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:15.068683 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-86d80f3e-8b95-42ea-9c24-34174c765332 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:15.069718 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-86d80f3e-8b95-42ea-9c24-34174c765332 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:15.071320 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-86d80f3e-8b95-42ea-9c24-34174c765332 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:15.072234 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-86d80f3e-8b95-42ea-9c24-34174c765332 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:15.072944 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-86d80f3e-8b95-42ea-9c24-34174c765332 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:15.097608 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-32578e45-a789-4619-a8dc-f537727cdacb req-8da57964-f34f-4745-b02c-374db8da1526 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c22c916b-390e-4bfe-8529-695bac5e5629", "tag": "80b3e074-a837-4fc6-943a-2a3be4791735"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:15.113224 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-32578e45-a789-4619-a8dc-f537727cdacb req-8da57964-f34f-4745-b02c-374db8da1526 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:15.114274 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-32578e45-a789-4619-a8dc-f537727cdacb req-8da57964-f34f-4745-b02c-374db8da1526 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:15.115068 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-32578e45-a789-4619-a8dc-f537727cdacb req-8da57964-f34f-4745-b02c-374db8da1526 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:15.121031 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=100 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:15.131748 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-32578e45-a789-4619-a8dc-f537727cdacb req-8da57964-f34f-4745-b02c-374db8da1526 service nova] Creating event network-changed:80b3e074-a837-4fc6-943a-2a3be4791735 for instance c22c916b-390e-4bfe-8529-695bac5e5629 on hv-cinder-85221 Sep 01 16:39:15.140057 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-32578e45-a789-4619-a8dc-f537727cdacb req-8da57964-f34f-4745-b02c-374db8da1526 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054040 Sep 01 16:39:15.144817 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 242/453] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:39:15.287291 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-f0aaf00a-882f-4025-8937-65a77c5da046 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:15.287917 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-f0aaf00a-882f-4025-8937-65a77c5da046 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 06e1b974-c011-46e9-92bf-1c64c1e07f2e] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:15.295267 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f0aaf00a-882f-4025-8937-65a77c5da046 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:15.296088 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f0aaf00a-882f-4025-8937-65a77c5da046 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:15.296708 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f0aaf00a-882f-4025-8937-65a77c5da046 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:15.297456 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f0aaf00a-882f-4025-8937-65a77c5da046 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:15.297903 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f0aaf00a-882f-4025-8937-65a77c5da046 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:15.298301 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f0aaf00a-882f-4025-8937-65a77c5da046 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:15.752728 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-f0aaf00a-882f-4025-8937-65a77c5da046 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fa5cd826e24f3992b537e56dc4e1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23aee15763f4997a71fa7e6864aa4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:15.767153 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-86d80f3e-8b95-42ea-9c24-34174c765332 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:15.775525 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-f0aaf00a-882f-4025-8937-65a77c5da046 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e" status: 200 len: 1314 microversion: 2.1 time: 0.491296 Sep 01 16:39:15.777372 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 243/454] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:15 2022] GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e => generated 1314 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:39:15.782202 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-86d80f3e-8b95-42ea-9c24-34174c765332 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:15.789867 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-86d80f3e-8b95-42ea-9c24-34174c765332 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:15.792393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-86d80f3e-8b95-42ea-9c24-34174c765332 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1810 microversion: 2.20 time: 0.745668 Sep 01 16:39:15.793015 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 212/455] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:15 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1810 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:39:16.798187 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0b2e4f3f-4d24-4b19-a47e-b1b8148e2505 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:16.798766 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-0b2e4f3f-4d24-4b19-a47e-b1b8148e2505 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 06e1b974-c011-46e9-92bf-1c64c1e07f2e] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:16.800887 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=2 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:16.801525 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=6 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:16.808845 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0b2e4f3f-4d24-4b19-a47e-b1b8148e2505 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:16.816405 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f772d1f2-ade6-4f34-905c-a394e7992bba tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:16.817016 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f772d1f2-ade6-4f34-905c-a394e7992bba tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:16.826096 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0b2e4f3f-4d24-4b19-a47e-b1b8148e2505 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:16.826886 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0b2e4f3f-4d24-4b19-a47e-b1b8148e2505 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:16.827812 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0b2e4f3f-4d24-4b19-a47e-b1b8148e2505 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:16.828292 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0b2e4f3f-4d24-4b19-a47e-b1b8148e2505 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:16.828861 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0b2e4f3f-4d24-4b19-a47e-b1b8148e2505 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:16.831481 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f772d1f2-ade6-4f34-905c-a394e7992bba tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:16.832410 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f772d1f2-ade6-4f34-905c-a394e7992bba tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:16.832976 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f772d1f2-ade6-4f34-905c-a394e7992bba tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:16.834004 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f772d1f2-ade6-4f34-905c-a394e7992bba tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:16.835015 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f772d1f2-ade6-4f34-905c-a394e7992bba tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:16.835725 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f772d1f2-ade6-4f34-905c-a394e7992bba tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:16.861444 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:17.269931 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-0b2e4f3f-4d24-4b19-a47e-b1b8148e2505 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fa5cd826e24f3992b537e56dc4e1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23aee15763f4997a71fa7e6864aa4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:17.278771 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-0b2e4f3f-4d24-4b19-a47e-b1b8148e2505 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e" status: 200 len: 1314 microversion: 2.1 time: 0.485156 Sep 01 16:39:17.279673 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 244/456] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:16 2022] GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e => generated 1314 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:17.287859 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f772d1f2-ade6-4f34-905c-a394e7992bba tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:17.299615 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f772d1f2-ade6-4f34-905c-a394e7992bba tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:17.301286 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f772d1f2-ade6-4f34-905c-a394e7992bba tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:17.302604 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f772d1f2-ade6-4f34-905c-a394e7992bba tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1810 microversion: 2.20 time: 0.490103 Sep 01 16:39:17.304150 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 213/457] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:16 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1810 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:39:18.300722 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a12775bf-bb90-45f2-ad8b-8f6cb69e4dd5 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:18.301360 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-a12775bf-bb90-45f2-ad8b-8f6cb69e4dd5 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 06e1b974-c011-46e9-92bf-1c64c1e07f2e] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:18.308931 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a12775bf-bb90-45f2-ad8b-8f6cb69e4dd5 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:18.309591 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a12775bf-bb90-45f2-ad8b-8f6cb69e4dd5 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:18.310206 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a12775bf-bb90-45f2-ad8b-8f6cb69e4dd5 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:18.311079 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a12775bf-bb90-45f2-ad8b-8f6cb69e4dd5 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:18.311539 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a12775bf-bb90-45f2-ad8b-8f6cb69e4dd5 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:18.312006 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a12775bf-bb90-45f2-ad8b-8f6cb69e4dd5 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:18.327672 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0e658a17-9cab-468d-9336-9a83e67bbf49 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:18.329069 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0e658a17-9cab-468d-9336-9a83e67bbf49 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:18.337351 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0e658a17-9cab-468d-9336-9a83e67bbf49 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:18.338123 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0e658a17-9cab-468d-9336-9a83e67bbf49 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:18.338813 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0e658a17-9cab-468d-9336-9a83e67bbf49 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:18.339919 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0e658a17-9cab-468d-9336-9a83e67bbf49 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:18.340579 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0e658a17-9cab-468d-9336-9a83e67bbf49 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:18.341716 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0e658a17-9cab-468d-9336-9a83e67bbf49 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:18.548885 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-a12775bf-bb90-45f2-ad8b-8f6cb69e4dd5 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fa5cd826e24f3992b537e56dc4e1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23aee15763f4997a71fa7e6864aa4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:18.557039 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-a12775bf-bb90-45f2-ad8b-8f6cb69e4dd5 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e" status: 200 len: 1314 microversion: 2.1 time: 0.260113 Sep 01 16:39:18.572058 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0e658a17-9cab-468d-9336-9a83e67bbf49 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:18.572727 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 245/458] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:18 2022] GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:18.579250 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0e658a17-9cab-468d-9336-9a83e67bbf49 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:18.580726 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0e658a17-9cab-468d-9336-9a83e67bbf49 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:18.581925 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0e658a17-9cab-468d-9336-9a83e67bbf49 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1810 microversion: 2.20 time: 0.259395 Sep 01 16:39:18.582492 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 214/459] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:18 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1810 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:39:19.580516 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-f724ac5c-2da9-4a37-8ad6-2fa6a922478c tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:19.581755 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-f724ac5c-2da9-4a37-8ad6-2fa6a922478c tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 06e1b974-c011-46e9-92bf-1c64c1e07f2e] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:19.585422 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:19.601592 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f724ac5c-2da9-4a37-8ad6-2fa6a922478c tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:19.602922 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f724ac5c-2da9-4a37-8ad6-2fa6a922478c tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:19.603701 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f724ac5c-2da9-4a37-8ad6-2fa6a922478c tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:19.604849 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f724ac5c-2da9-4a37-8ad6-2fa6a922478c tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:19.605457 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f724ac5c-2da9-4a37-8ad6-2fa6a922478c tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:19.606066 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f724ac5c-2da9-4a37-8ad6-2fa6a922478c tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:19.613514 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7be12b2d-f14e-47ed-875b-728e196c278f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:19.615154 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7be12b2d-f14e-47ed-875b-728e196c278f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:19.626701 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7be12b2d-f14e-47ed-875b-728e196c278f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:19.627358 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7be12b2d-f14e-47ed-875b-728e196c278f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:19.627809 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7be12b2d-f14e-47ed-875b-728e196c278f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:19.628681 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7be12b2d-f14e-47ed-875b-728e196c278f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:19.629758 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7be12b2d-f14e-47ed-875b-728e196c278f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:19.629758 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7be12b2d-f14e-47ed-875b-728e196c278f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:19.862879 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-f724ac5c-2da9-4a37-8ad6-2fa6a922478c tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fa5cd826e24f3992b537e56dc4e1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23aee15763f4997a71fa7e6864aa4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:19.871480 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-f724ac5c-2da9-4a37-8ad6-2fa6a922478c tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e" status: 200 len: 1314 microversion: 2.1 time: 0.295480 Sep 01 16:39:19.872734 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7be12b2d-f14e-47ed-875b-728e196c278f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:19.884676 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7be12b2d-f14e-47ed-875b-728e196c278f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:19.885802 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 246/460] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:19 2022] GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:39:19.886101 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7be12b2d-f14e-47ed-875b-728e196c278f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:19.887459 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7be12b2d-f14e-47ed-875b-728e196c278f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1810 microversion: 2.20 time: 0.284868 Sep 01 16:39:19.888352 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 215/461] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:19 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1810 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:39:20.894038 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-1e0526ef-4950-4764-a36f-dcda5a7adbff tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:20.895678 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-1e0526ef-4950-4764-a36f-dcda5a7adbff tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 06e1b974-c011-46e9-92bf-1c64c1e07f2e] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:20.902698 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1e0526ef-4950-4764-a36f-dcda5a7adbff tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:20.903548 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1e0526ef-4950-4764-a36f-dcda5a7adbff tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:20.904068 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1e0526ef-4950-4764-a36f-dcda5a7adbff tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:20.905192 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1e0526ef-4950-4764-a36f-dcda5a7adbff tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:20.905743 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1e0526ef-4950-4764-a36f-dcda5a7adbff tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:20.906170 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1e0526ef-4950-4764-a36f-dcda5a7adbff tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:20.912464 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0bd96fab-183f-4245-a5c1-eeaf87771f50 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:20.913158 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0bd96fab-183f-4245-a5c1-eeaf87771f50 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:20.922605 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0bd96fab-183f-4245-a5c1-eeaf87771f50 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:20.923408 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0bd96fab-183f-4245-a5c1-eeaf87771f50 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:20.924152 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0bd96fab-183f-4245-a5c1-eeaf87771f50 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:20.925282 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0bd96fab-183f-4245-a5c1-eeaf87771f50 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:20.925995 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0bd96fab-183f-4245-a5c1-eeaf87771f50 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:20.926685 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0bd96fab-183f-4245-a5c1-eeaf87771f50 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:21.122730 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-1e0526ef-4950-4764-a36f-dcda5a7adbff tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fa5cd826e24f3992b537e56dc4e1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23aee15763f4997a71fa7e6864aa4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:21.131924 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-1e0526ef-4950-4764-a36f-dcda5a7adbff tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e" status: 200 len: 1314 microversion: 2.1 time: 0.241812 Sep 01 16:39:21.132772 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 247/462] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:20 2022] GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:21.151578 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0bd96fab-183f-4245-a5c1-eeaf87771f50 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:21.161848 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0bd96fab-183f-4245-a5c1-eeaf87771f50 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:21.163280 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0bd96fab-183f-4245-a5c1-eeaf87771f50 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:21.164503 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0bd96fab-183f-4245-a5c1-eeaf87771f50 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1810 microversion: 2.20 time: 0.256434 Sep 01 16:39:21.171962 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 216/463] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:20 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1810 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:39:21.594257 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-a50346f8-84c3-446a-b91e-0eaec16195ed req-d89cd691-8323-4a84-b4c9-ae491ef691ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06e1b974-c011-46e9-92bf-1c64c1e07f2e", "name": "network-vif-plugged", "status": "completed", "tag": "3a6d27f2-6a34-4a5a-b9d4-a058b540eda9"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:21.604101 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-a50346f8-84c3-446a-b91e-0eaec16195ed req-d89cd691-8323-4a84-b4c9-ae491ef691ca service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:21.604557 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-a50346f8-84c3-446a-b91e-0eaec16195ed req-d89cd691-8323-4a84-b4c9-ae491ef691ca service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:21.604983 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-a50346f8-84c3-446a-b91e-0eaec16195ed req-d89cd691-8323-4a84-b4c9-ae491ef691ca service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:21.619611 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-a50346f8-84c3-446a-b91e-0eaec16195ed req-d89cd691-8323-4a84-b4c9-ae491ef691ca service nova] Creating event network-vif-plugged:3a6d27f2-6a34-4a5a-b9d4-a058b540eda9 for instance 06e1b974-c011-46e9-92bf-1c64c1e07f2e on hv-cinder-85221 Sep 01 16:39:21.625413 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-a50346f8-84c3-446a-b91e-0eaec16195ed req-d89cd691-8323-4a84-b4c9-ae491ef691ca service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034990 Sep 01 16:39:21.626385 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 248/464] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:39:22.156074 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8a47f4a7-7ed0-4150-8e27-8ed1b7b33f85 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:22.156717 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8a47f4a7-7ed0-4150-8e27-8ed1b7b33f85 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 06e1b974-c011-46e9-92bf-1c64c1e07f2e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:22.163613 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8a47f4a7-7ed0-4150-8e27-8ed1b7b33f85 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:22.164137 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8a47f4a7-7ed0-4150-8e27-8ed1b7b33f85 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:22.164572 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8a47f4a7-7ed0-4150-8e27-8ed1b7b33f85 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:22.165315 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8a47f4a7-7ed0-4150-8e27-8ed1b7b33f85 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:22.165770 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8a47f4a7-7ed0-4150-8e27-8ed1b7b33f85 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:22.166192 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8a47f4a7-7ed0-4150-8e27-8ed1b7b33f85 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:22.190965 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-6fe27f71-1566-495f-8027-823107494e0d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:22.193332 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-6fe27f71-1566-495f-8027-823107494e0d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:22.204662 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6fe27f71-1566-495f-8027-823107494e0d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:22.205438 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6fe27f71-1566-495f-8027-823107494e0d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:22.206133 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6fe27f71-1566-495f-8027-823107494e0d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:22.206852 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6fe27f71-1566-495f-8027-823107494e0d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:22.207308 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6fe27f71-1566-495f-8027-823107494e0d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:22.207708 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6fe27f71-1566-495f-8027-823107494e0d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:22.384723 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8a47f4a7-7ed0-4150-8e27-8ed1b7b33f85 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fa5cd826e24f3992b537e56dc4e1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23aee15763f4997a71fa7e6864aa4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:22.396797 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8a47f4a7-7ed0-4150-8e27-8ed1b7b33f85 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e" status: 200 len: 1314 microversion: 2.1 time: 0.245678 Sep 01 16:39:22.397489 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 217/465] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:22 2022] GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:22.413689 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-6fe27f71-1566-495f-8027-823107494e0d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:22.424640 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-6fe27f71-1566-495f-8027-823107494e0d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:22.426083 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-6fe27f71-1566-495f-8027-823107494e0d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:22.427258 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-6fe27f71-1566-495f-8027-823107494e0d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1810 microversion: 2.20 time: 0.241948 Sep 01 16:39:22.427942 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 249/466] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:22 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1810 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:39:23.419910 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-dbfc72a0-e4e2-4efe-8686-0c4c07e93db5 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:23.420638 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-dbfc72a0-e4e2-4efe-8686-0c4c07e93db5 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 06e1b974-c011-46e9-92bf-1c64c1e07f2e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:23.428371 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dbfc72a0-e4e2-4efe-8686-0c4c07e93db5 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:23.428864 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dbfc72a0-e4e2-4efe-8686-0c4c07e93db5 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:23.429316 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dbfc72a0-e4e2-4efe-8686-0c4c07e93db5 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:23.429996 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dbfc72a0-e4e2-4efe-8686-0c4c07e93db5 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:23.430445 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dbfc72a0-e4e2-4efe-8686-0c4c07e93db5 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:23.430862 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dbfc72a0-e4e2-4efe-8686-0c4c07e93db5 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:23.453458 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-6e0f8856-354b-42e3-b24e-dea57e8ceeb5 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:23.454460 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-6e0f8856-354b-42e3-b24e-dea57e8ceeb5 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:23.461338 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6e0f8856-354b-42e3-b24e-dea57e8ceeb5 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:23.461900 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6e0f8856-354b-42e3-b24e-dea57e8ceeb5 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:23.462338 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6e0f8856-354b-42e3-b24e-dea57e8ceeb5 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:23.463058 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6e0f8856-354b-42e3-b24e-dea57e8ceeb5 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:23.463507 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6e0f8856-354b-42e3-b24e-dea57e8ceeb5 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:23.463956 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6e0f8856-354b-42e3-b24e-dea57e8ceeb5 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:23.669471 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-dbfc72a0-e4e2-4efe-8686-0c4c07e93db5 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fa5cd826e24f3992b537e56dc4e1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23aee15763f4997a71fa7e6864aa4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:23.677834 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-dbfc72a0-e4e2-4efe-8686-0c4c07e93db5 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e" status: 200 len: 1314 microversion: 2.1 time: 0.262870 Sep 01 16:39:23.678532 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 218/467] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:23 2022] GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:23.683418 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-6e0f8856-354b-42e3-b24e-dea57e8ceeb5 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:23.692599 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-6e0f8856-354b-42e3-b24e-dea57e8ceeb5 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:23.694033 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-6e0f8856-354b-42e3-b24e-dea57e8ceeb5 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:23.695224 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-6e0f8856-354b-42e3-b24e-dea57e8ceeb5 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1810 microversion: 2.20 time: 0.248252 Sep 01 16:39:23.695794 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 250/468] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:23 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1810 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:39:24.703249 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-eb7e82ac-f2fb-425a-b92f-d0927f4e4cd1 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:24.704296 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-eb7e82ac-f2fb-425a-b92f-d0927f4e4cd1 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 06e1b974-c011-46e9-92bf-1c64c1e07f2e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:24.720673 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eb7e82ac-f2fb-425a-b92f-d0927f4e4cd1 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:24.721917 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eb7e82ac-f2fb-425a-b92f-d0927f4e4cd1 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:24.722451 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eb7e82ac-f2fb-425a-b92f-d0927f4e4cd1 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:24.723211 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eb7e82ac-f2fb-425a-b92f-d0927f4e4cd1 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:24.723667 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eb7e82ac-f2fb-425a-b92f-d0927f4e4cd1 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:24.724233 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eb7e82ac-f2fb-425a-b92f-d0927f4e4cd1 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:24.725798 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-bd0e8a45-bbb8-480d-ab6b-cffc308d2c8c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:24.727776 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-bd0e8a45-bbb8-480d-ab6b-cffc308d2c8c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:24.737061 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bd0e8a45-bbb8-480d-ab6b-cffc308d2c8c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:24.737731 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bd0e8a45-bbb8-480d-ab6b-cffc308d2c8c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:24.738288 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bd0e8a45-bbb8-480d-ab6b-cffc308d2c8c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:24.739048 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bd0e8a45-bbb8-480d-ab6b-cffc308d2c8c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:24.739501 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bd0e8a45-bbb8-480d-ab6b-cffc308d2c8c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:24.740019 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bd0e8a45-bbb8-480d-ab6b-cffc308d2c8c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:24.947882 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-eb7e82ac-f2fb-425a-b92f-d0927f4e4cd1 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fa5cd826e24f3992b537e56dc4e1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23aee15763f4997a71fa7e6864aa4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:24.958355 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-eb7e82ac-f2fb-425a-b92f-d0927f4e4cd1 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e" status: 200 len: 1314 microversion: 2.1 time: 0.262445 Sep 01 16:39:24.962129 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 219/469] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:24 2022] GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:24.970688 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-bd0e8a45-bbb8-480d-ab6b-cffc308d2c8c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:24.983964 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-bd0e8a45-bbb8-480d-ab6b-cffc308d2c8c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:24.985743 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-bd0e8a45-bbb8-480d-ab6b-cffc308d2c8c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:24.987208 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-bd0e8a45-bbb8-480d-ab6b-cffc308d2c8c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1810 microversion: 2.20 time: 0.268073 Sep 01 16:39:24.988374 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 251/470] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:24 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1810 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:39:25.981707 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f855eaf9-7e87-4c20-8090-148023630a09 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:25.982871 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f855eaf9-7e87-4c20-8090-148023630a09 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 06e1b974-c011-46e9-92bf-1c64c1e07f2e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:25.993113 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f855eaf9-7e87-4c20-8090-148023630a09 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:25.993738 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f855eaf9-7e87-4c20-8090-148023630a09 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:25.994173 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f855eaf9-7e87-4c20-8090-148023630a09 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:25.994891 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f855eaf9-7e87-4c20-8090-148023630a09 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:25.995351 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f855eaf9-7e87-4c20-8090-148023630a09 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:25.995772 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f855eaf9-7e87-4c20-8090-148023630a09 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:26.016991 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8a53273d-a63d-432f-8b11-29ef00d8fbbb tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:26.018070 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-8a53273d-a63d-432f-8b11-29ef00d8fbbb tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:26.029003 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8a53273d-a63d-432f-8b11-29ef00d8fbbb tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:26.029879 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8a53273d-a63d-432f-8b11-29ef00d8fbbb tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:26.030896 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8a53273d-a63d-432f-8b11-29ef00d8fbbb tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:26.031854 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8a53273d-a63d-432f-8b11-29ef00d8fbbb tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:26.032648 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8a53273d-a63d-432f-8b11-29ef00d8fbbb tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:26.033320 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8a53273d-a63d-432f-8b11-29ef00d8fbbb tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:26.233846 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f855eaf9-7e87-4c20-8090-148023630a09 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fa5cd826e24f3992b537e56dc4e1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23aee15763f4997a71fa7e6864aa4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:26.249521 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f855eaf9-7e87-4c20-8090-148023630a09 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e" status: 200 len: 1314 microversion: 2.1 time: 0.271952 Sep 01 16:39:26.250441 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 220/471] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:25 2022] GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:26.269274 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8a53273d-a63d-432f-8b11-29ef00d8fbbb tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:26.279422 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8a53273d-a63d-432f-8b11-29ef00d8fbbb tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:26.280919 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8a53273d-a63d-432f-8b11-29ef00d8fbbb tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:26.282126 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8a53273d-a63d-432f-8b11-29ef00d8fbbb tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1810 microversion: 2.20 time: 0.274735 Sep 01 16:39:26.282684 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 252/472] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:26 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1810 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:39:27.272647 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2e88cf99-5e3c-4e87-9b04-9d81e0506e64 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:27.273372 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-2e88cf99-5e3c-4e87-9b04-9d81e0506e64 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 06e1b974-c011-46e9-92bf-1c64c1e07f2e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:27.281624 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e88cf99-5e3c-4e87-9b04-9d81e0506e64 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:27.282348 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e88cf99-5e3c-4e87-9b04-9d81e0506e64 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:27.283237 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e88cf99-5e3c-4e87-9b04-9d81e0506e64 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:27.283512 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e88cf99-5e3c-4e87-9b04-9d81e0506e64 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:27.284092 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e88cf99-5e3c-4e87-9b04-9d81e0506e64 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:27.284466 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e88cf99-5e3c-4e87-9b04-9d81e0506e64 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:27.304758 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-32162c9b-c613-4397-9dd3-764b7b4eee79 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:27.305440 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-32162c9b-c613-4397-9dd3-764b7b4eee79 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:27.311828 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-32162c9b-c613-4397-9dd3-764b7b4eee79 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:27.312353 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-32162c9b-c613-4397-9dd3-764b7b4eee79 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:27.312782 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-32162c9b-c613-4397-9dd3-764b7b4eee79 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:27.313482 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-32162c9b-c613-4397-9dd3-764b7b4eee79 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:27.313964 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-32162c9b-c613-4397-9dd3-764b7b4eee79 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:27.314378 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-32162c9b-c613-4397-9dd3-764b7b4eee79 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:27.514766 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2e88cf99-5e3c-4e87-9b04-9d81e0506e64 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fa5cd826e24f3992b537e56dc4e1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23aee15763f4997a71fa7e6864aa4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:27.524248 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2e88cf99-5e3c-4e87-9b04-9d81e0506e64 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e" status: 200 len: 1314 microversion: 2.1 time: 0.255405 Sep 01 16:39:27.525478 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 221/473] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:27 2022] GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:27.529622 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-32162c9b-c613-4397-9dd3-764b7b4eee79 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:27.541300 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-32162c9b-c613-4397-9dd3-764b7b4eee79 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:27.542808 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-32162c9b-c613-4397-9dd3-764b7b4eee79 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:27.544076 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-32162c9b-c613-4397-9dd3-764b7b4eee79 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1810 microversion: 2.20 time: 0.243216 Sep 01 16:39:27.544638 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 253/474] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:27 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1810 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:39:28.546566 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b423bb41-635b-462e-9145-3a7a9fa24c3b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:28.547134 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b423bb41-635b-462e-9145-3a7a9fa24c3b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 06e1b974-c011-46e9-92bf-1c64c1e07f2e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:28.554307 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b423bb41-635b-462e-9145-3a7a9fa24c3b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:28.554790 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b423bb41-635b-462e-9145-3a7a9fa24c3b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:28.555225 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b423bb41-635b-462e-9145-3a7a9fa24c3b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:28.555955 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b423bb41-635b-462e-9145-3a7a9fa24c3b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:28.556410 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b423bb41-635b-462e-9145-3a7a9fa24c3b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:28.556832 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b423bb41-635b-462e-9145-3a7a9fa24c3b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:28.560496 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:28.568241 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a852729d-1436-46d4-9b52-fc1d68e9b77c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:28.568833 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-a852729d-1436-46d4-9b52-fc1d68e9b77c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:28.575511 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a852729d-1436-46d4-9b52-fc1d68e9b77c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:28.576701 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a852729d-1436-46d4-9b52-fc1d68e9b77c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:28.577299 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a852729d-1436-46d4-9b52-fc1d68e9b77c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:28.578252 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a852729d-1436-46d4-9b52-fc1d68e9b77c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:28.578961 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a852729d-1436-46d4-9b52-fc1d68e9b77c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:28.579375 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a852729d-1436-46d4-9b52-fc1d68e9b77c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:28.764674 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b423bb41-635b-462e-9145-3a7a9fa24c3b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fa5cd826e24f3992b537e56dc4e1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23aee15763f4997a71fa7e6864aa4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:28.773597 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b423bb41-635b-462e-9145-3a7a9fa24c3b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e" status: 200 len: 1314 microversion: 2.1 time: 0.231426 Sep 01 16:39:28.774616 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 222/475] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:28 2022] GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:28.788404 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-a852729d-1436-46d4-9b52-fc1d68e9b77c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:28.801697 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-a852729d-1436-46d4-9b52-fc1d68e9b77c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:28.803059 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-a852729d-1436-46d4-9b52-fc1d68e9b77c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:28.804268 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-a852729d-1436-46d4-9b52-fc1d68e9b77c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1810 microversion: 2.20 time: 0.240011 Sep 01 16:39:28.804823 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 254/476] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:28 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1810 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:39:29.795265 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6bc0f452-73c4-4815-a410-f7a106ff7ab8 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:29.795963 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-6bc0f452-73c4-4815-a410-f7a106ff7ab8 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 06e1b974-c011-46e9-92bf-1c64c1e07f2e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:29.803202 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6bc0f452-73c4-4815-a410-f7a106ff7ab8 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:29.803685 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6bc0f452-73c4-4815-a410-f7a106ff7ab8 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:29.804166 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6bc0f452-73c4-4815-a410-f7a106ff7ab8 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:29.804880 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6bc0f452-73c4-4815-a410-f7a106ff7ab8 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:29.805311 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6bc0f452-73c4-4815-a410-f7a106ff7ab8 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:29.805787 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6bc0f452-73c4-4815-a410-f7a106ff7ab8 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:29.828478 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-52c1582f-0fbe-4444-bd7e-5b41b27514d8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:29.829071 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-52c1582f-0fbe-4444-bd7e-5b41b27514d8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:29.835546 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-52c1582f-0fbe-4444-bd7e-5b41b27514d8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:29.836073 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-52c1582f-0fbe-4444-bd7e-5b41b27514d8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:29.836528 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-52c1582f-0fbe-4444-bd7e-5b41b27514d8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:29.837216 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-52c1582f-0fbe-4444-bd7e-5b41b27514d8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:29.837661 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-52c1582f-0fbe-4444-bd7e-5b41b27514d8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:29.838080 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-52c1582f-0fbe-4444-bd7e-5b41b27514d8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:30.437103 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-6bc0f452-73c4-4815-a410-f7a106ff7ab8 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fa5cd826e24f3992b537e56dc4e1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23aee15763f4997a71fa7e6864aa4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:30.445989 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-6bc0f452-73c4-4815-a410-f7a106ff7ab8 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e" status: 200 len: 1314 microversion: 2.1 time: 0.654691 Sep 01 16:39:30.459925 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 223/477] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:29 2022] GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e => generated 1314 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:30.490351 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-52c1582f-0fbe-4444-bd7e-5b41b27514d8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:30.499833 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-52c1582f-0fbe-4444-bd7e-5b41b27514d8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:30.501323 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-52c1582f-0fbe-4444-bd7e-5b41b27514d8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:30.502553 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-52c1582f-0fbe-4444-bd7e-5b41b27514d8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1810 microversion: 2.20 time: 0.678380 Sep 01 16:39:30.503120 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 255/478] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:29 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1810 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:39:31.471469 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-42640f3c-5507-4a02-9886-7a1e51552ddc tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:31.472600 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-42640f3c-5507-4a02-9886-7a1e51552ddc tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 06e1b974-c011-46e9-92bf-1c64c1e07f2e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:31.484487 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-42640f3c-5507-4a02-9886-7a1e51552ddc tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:31.484982 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-42640f3c-5507-4a02-9886-7a1e51552ddc tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:31.485417 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-42640f3c-5507-4a02-9886-7a1e51552ddc tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:31.486126 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-42640f3c-5507-4a02-9886-7a1e51552ddc tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:31.486578 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-42640f3c-5507-4a02-9886-7a1e51552ddc tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:31.487017 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-42640f3c-5507-4a02-9886-7a1e51552ddc tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:31.526822 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-401e1225-a62f-47aa-a2d9-19266cbd48d3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:31.527426 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-401e1225-a62f-47aa-a2d9-19266cbd48d3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:31.534478 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-401e1225-a62f-47aa-a2d9-19266cbd48d3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:31.534969 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-401e1225-a62f-47aa-a2d9-19266cbd48d3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:31.535393 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-401e1225-a62f-47aa-a2d9-19266cbd48d3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:31.536128 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-401e1225-a62f-47aa-a2d9-19266cbd48d3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:31.536569 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-401e1225-a62f-47aa-a2d9-19266cbd48d3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:31.536981 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-401e1225-a62f-47aa-a2d9-19266cbd48d3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:31.782129 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-42640f3c-5507-4a02-9886-7a1e51552ddc tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fa5cd826e24f3992b537e56dc4e1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23aee15763f4997a71fa7e6864aa4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:31.789895 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-42640f3c-5507-4a02-9886-7a1e51552ddc tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e" status: 200 len: 1314 microversion: 2.1 time: 0.322948 Sep 01 16:39:31.790471 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 224/479] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:31 2022] GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:31.793497 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-401e1225-a62f-47aa-a2d9-19266cbd48d3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:31.802523 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-401e1225-a62f-47aa-a2d9-19266cbd48d3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:31.803951 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-401e1225-a62f-47aa-a2d9-19266cbd48d3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:31.805120 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-401e1225-a62f-47aa-a2d9-19266cbd48d3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1810 microversion: 2.20 time: 0.282300 Sep 01 16:39:31.805668 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 256/480] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:31 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1810 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:39:32.812599 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-940543dd-d131-446b-b9a2-f8dc02a9e1e8 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:32.813236 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-940543dd-d131-446b-b9a2-f8dc02a9e1e8 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 06e1b974-c011-46e9-92bf-1c64c1e07f2e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:32.820638 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-940543dd-d131-446b-b9a2-f8dc02a9e1e8 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:32.821129 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-940543dd-d131-446b-b9a2-f8dc02a9e1e8 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:32.821606 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-940543dd-d131-446b-b9a2-f8dc02a9e1e8 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:32.822325 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-940543dd-d131-446b-b9a2-f8dc02a9e1e8 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:32.822787 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-940543dd-d131-446b-b9a2-f8dc02a9e1e8 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:32.823290 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-940543dd-d131-446b-b9a2-f8dc02a9e1e8 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:32.829226 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d0f1a3dd-cfbb-4244-aecb-41554eddfab6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:32.829832 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d0f1a3dd-cfbb-4244-aecb-41554eddfab6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:32.836520 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d0f1a3dd-cfbb-4244-aecb-41554eddfab6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:32.837029 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d0f1a3dd-cfbb-4244-aecb-41554eddfab6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:32.837475 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d0f1a3dd-cfbb-4244-aecb-41554eddfab6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:32.838251 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d0f1a3dd-cfbb-4244-aecb-41554eddfab6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:32.838692 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d0f1a3dd-cfbb-4244-aecb-41554eddfab6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:32.839143 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d0f1a3dd-cfbb-4244-aecb-41554eddfab6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:33.044837 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-940543dd-d131-446b-b9a2-f8dc02a9e1e8 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fa5cd826e24f3992b537e56dc4e1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23aee15763f4997a71fa7e6864aa4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:33.049350 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d0f1a3dd-cfbb-4244-aecb-41554eddfab6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:33.053838 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-940543dd-d131-446b-b9a2-f8dc02a9e1e8 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e" status: 200 len: 1497 microversion: 2.1 time: 0.245781 Sep 01 16:39:33.054388 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 225/481] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:32 2022] GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e => generated 1497 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:33.058686 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d0f1a3dd-cfbb-4244-aecb-41554eddfab6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:33.060436 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d0f1a3dd-cfbb-4244-aecb-41554eddfab6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:33.061600 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d0f1a3dd-cfbb-4244-aecb-41554eddfab6 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1810 microversion: 2.20 time: 0.237076 Sep 01 16:39:33.062162 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 257/482] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:32 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1810 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:39:33.630781 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-84110692-c9ef-43fe-b03c-e7348c493c0e tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:33.631565 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-84110692-c9ef-43fe-b03c-e7348c493c0e tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 06e1b974-c011-46e9-92bf-1c64c1e07f2e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:33.640143 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-84110692-c9ef-43fe-b03c-e7348c493c0e tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:33.640665 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-84110692-c9ef-43fe-b03c-e7348c493c0e tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:33.641144 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-84110692-c9ef-43fe-b03c-e7348c493c0e tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:33.641867 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-84110692-c9ef-43fe-b03c-e7348c493c0e tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:33.642318 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-84110692-c9ef-43fe-b03c-e7348c493c0e tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:33.642729 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-84110692-c9ef-43fe-b03c-e7348c493c0e tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:33.669633 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-84110692-c9ef-43fe-b03c-e7348c493c0e tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 06e1b974-c011-46e9-92bf-1c64c1e07f2e] Going to try to terminate instance {{(pid=127198) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:39:33.757816 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-84110692-c9ef-43fe-b03c-e7348c493c0e tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "DELETE /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e" status: 204 len: 0 microversion: 2.1 time: 0.132170 Sep 01 16:39:33.758658 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 226/483] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Sep 1 16:39:33 2022] DELETE /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:39:33.767393 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-44bc228c-bd03-4359-b9f5-17556f1b27b9 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:33.767543 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-44bc228c-bd03-4359-b9f5-17556f1b27b9 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 06e1b974-c011-46e9-92bf-1c64c1e07f2e] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:33.774125 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-44bc228c-bd03-4359-b9f5-17556f1b27b9 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:33.774619 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-44bc228c-bd03-4359-b9f5-17556f1b27b9 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:33.775063 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-44bc228c-bd03-4359-b9f5-17556f1b27b9 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:33.775753 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-44bc228c-bd03-4359-b9f5-17556f1b27b9 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:33.776264 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-44bc228c-bd03-4359-b9f5-17556f1b27b9 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:33.776680 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-44bc228c-bd03-4359-b9f5-17556f1b27b9 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:33.931764 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-44bc228c-bd03-4359-b9f5-17556f1b27b9 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fa5cd826e24f3992b537e56dc4e1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23aee15763f4997a71fa7e6864aa4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:33.940680 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-44bc228c-bd03-4359-b9f5-17556f1b27b9 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e" status: 200 len: 1503 microversion: 2.1 time: 0.177631 Sep 01 16:39:33.941331 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 258/484] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:33 2022] GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e => generated 1503 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:34.087992 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7dfebd2b-f90f-4425-a411-674bbd57e68a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:34.089157 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7dfebd2b-f90f-4425-a411-674bbd57e68a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:34.097140 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7dfebd2b-f90f-4425-a411-674bbd57e68a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:34.097610 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7dfebd2b-f90f-4425-a411-674bbd57e68a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:34.098042 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7dfebd2b-f90f-4425-a411-674bbd57e68a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:34.098731 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7dfebd2b-f90f-4425-a411-674bbd57e68a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:34.099172 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7dfebd2b-f90f-4425-a411-674bbd57e68a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:34.099586 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7dfebd2b-f90f-4425-a411-674bbd57e68a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:34.269565 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7dfebd2b-f90f-4425-a411-674bbd57e68a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:34.279708 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7dfebd2b-f90f-4425-a411-674bbd57e68a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:34.281929 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7dfebd2b-f90f-4425-a411-674bbd57e68a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:34.283158 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7dfebd2b-f90f-4425-a411-674bbd57e68a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1810 microversion: 2.20 time: 0.200532 Sep 01 16:39:34.283750 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 227/485] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:34 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1810 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:39:34.972567 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-3c1b8f78-0266-42ce-88d3-3f49a6558f4f tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:34.973400 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-3c1b8f78-0266-42ce-88d3-3f49a6558f4f tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 06e1b974-c011-46e9-92bf-1c64c1e07f2e] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:34.982110 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3c1b8f78-0266-42ce-88d3-3f49a6558f4f tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:34.982744 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3c1b8f78-0266-42ce-88d3-3f49a6558f4f tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:34.983306 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3c1b8f78-0266-42ce-88d3-3f49a6558f4f tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:34.984146 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3c1b8f78-0266-42ce-88d3-3f49a6558f4f tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:34.984665 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3c1b8f78-0266-42ce-88d3-3f49a6558f4f tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:34.985084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3c1b8f78-0266-42ce-88d3-3f49a6558f4f tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:35.148557 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-3c1b8f78-0266-42ce-88d3-3f49a6558f4f tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fa5cd826e24f3992b537e56dc4e1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23aee15763f4997a71fa7e6864aa4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:35.161003 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-3c1b8f78-0266-42ce-88d3-3f49a6558f4f tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e" status: 200 len: 1503 microversion: 2.1 time: 0.193763 Sep 01 16:39:35.161767 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 259/486] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:34 2022] GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e => generated 1503 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:35.308995 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e6a55d93-cc64-4083-9661-bf0802d14c5a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:35.309678 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e6a55d93-cc64-4083-9661-bf0802d14c5a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:35.317411 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e6a55d93-cc64-4083-9661-bf0802d14c5a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:35.317910 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e6a55d93-cc64-4083-9661-bf0802d14c5a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:35.318348 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e6a55d93-cc64-4083-9661-bf0802d14c5a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:35.319082 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e6a55d93-cc64-4083-9661-bf0802d14c5a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:35.319531 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e6a55d93-cc64-4083-9661-bf0802d14c5a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:35.319961 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e6a55d93-cc64-4083-9661-bf0802d14c5a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:35.487628 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e6a55d93-cc64-4083-9661-bf0802d14c5a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:35.500033 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e6a55d93-cc64-4083-9661-bf0802d14c5a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:35.501758 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e6a55d93-cc64-4083-9661-bf0802d14c5a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:35.503180 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e6a55d93-cc64-4083-9661-bf0802d14c5a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1810 microversion: 2.20 time: 0.198189 Sep 01 16:39:35.503856 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 228/487] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:35 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1810 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:39:36.186901 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-21cf9ae5-80fe-4a61-a797-b2515b14a9af tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:36.187549 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-21cf9ae5-80fe-4a61-a797-b2515b14a9af tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 06e1b974-c011-46e9-92bf-1c64c1e07f2e] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:36.193958 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-21cf9ae5-80fe-4a61-a797-b2515b14a9af tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:36.194444 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-21cf9ae5-80fe-4a61-a797-b2515b14a9af tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:36.195087 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-21cf9ae5-80fe-4a61-a797-b2515b14a9af tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:36.196008 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-21cf9ae5-80fe-4a61-a797-b2515b14a9af tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:36.196462 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-21cf9ae5-80fe-4a61-a797-b2515b14a9af tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:36.196890 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-21cf9ae5-80fe-4a61-a797-b2515b14a9af tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:36.199790 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=100 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:36.352887 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-21cf9ae5-80fe-4a61-a797-b2515b14a9af tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fa5cd826e24f3992b537e56dc4e1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23aee15763f4997a71fa7e6864aa4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:36.361672 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-21cf9ae5-80fe-4a61-a797-b2515b14a9af tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e" status: 200 len: 1503 microversion: 2.1 time: 0.180583 Sep 01 16:39:36.362267 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 260/488] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:36 2022] GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e => generated 1503 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:36.530773 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ed5dbc0e-f909-445e-bea7-4c9f948f5ccc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:36.531414 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ed5dbc0e-f909-445e-bea7-4c9f948f5ccc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:36.538985 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ed5dbc0e-f909-445e-bea7-4c9f948f5ccc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:36.538985 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ed5dbc0e-f909-445e-bea7-4c9f948f5ccc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:36.539286 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ed5dbc0e-f909-445e-bea7-4c9f948f5ccc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:36.539787 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ed5dbc0e-f909-445e-bea7-4c9f948f5ccc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:36.540284 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ed5dbc0e-f909-445e-bea7-4c9f948f5ccc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:36.540705 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ed5dbc0e-f909-445e-bea7-4c9f948f5ccc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:36.694389 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ed5dbc0e-f909-445e-bea7-4c9f948f5ccc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:36.704303 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ed5dbc0e-f909-445e-bea7-4c9f948f5ccc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:36.705769 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ed5dbc0e-f909-445e-bea7-4c9f948f5ccc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:36.706937 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ed5dbc0e-f909-445e-bea7-4c9f948f5ccc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1810 microversion: 2.20 time: 0.180295 Sep 01 16:39:36.707506 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 229/489] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:36 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1810 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:39:37.385974 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-45caa676-95c1-4f45-8d98-db51b2e74d17 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:37.386608 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-45caa676-95c1-4f45-8d98-db51b2e74d17 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 06e1b974-c011-46e9-92bf-1c64c1e07f2e] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:37.394849 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-45caa676-95c1-4f45-8d98-db51b2e74d17 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:37.395363 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-45caa676-95c1-4f45-8d98-db51b2e74d17 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:37.395800 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-45caa676-95c1-4f45-8d98-db51b2e74d17 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:37.396577 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-45caa676-95c1-4f45-8d98-db51b2e74d17 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:37.397065 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-45caa676-95c1-4f45-8d98-db51b2e74d17 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:37.397487 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-45caa676-95c1-4f45-8d98-db51b2e74d17 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:37.504510 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-45caa676-95c1-4f45-8d98-db51b2e74d17 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fa5cd826e24f3992b537e56dc4e1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23aee15763f4997a71fa7e6864aa4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:37.515945 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-45caa676-95c1-4f45-8d98-db51b2e74d17 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e" status: 200 len: 1461 microversion: 2.1 time: 0.134203 Sep 01 16:39:37.516812 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-3ddd1868-1495-4c3a-a34e-8bfb000cd330 req-2b95850d-040a-400c-bf8c-46a2affe7e70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06e1b974-c011-46e9-92bf-1c64c1e07f2e", "name": "network-vif-deleted", "tag": "3a6d27f2-6a34-4a5a-b9d4-a058b540eda9"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:37.516971 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 261/490] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:37 2022] GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e => generated 1461 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:37.527352 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-3ddd1868-1495-4c3a-a34e-8bfb000cd330 req-2b95850d-040a-400c-bf8c-46a2affe7e70 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:37.527836 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-3ddd1868-1495-4c3a-a34e-8bfb000cd330 req-2b95850d-040a-400c-bf8c-46a2affe7e70 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:37.531387 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-3ddd1868-1495-4c3a-a34e-8bfb000cd330 req-2b95850d-040a-400c-bf8c-46a2affe7e70 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:37.542687 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-3ddd1868-1495-4c3a-a34e-8bfb000cd330 req-2b95850d-040a-400c-bf8c-46a2affe7e70 service nova] Creating event network-vif-deleted:3a6d27f2-6a34-4a5a-b9d4-a058b540eda9 for instance 06e1b974-c011-46e9-92bf-1c64c1e07f2e on hv-cinder-85221 Sep 01 16:39:37.548507 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-3ddd1868-1495-4c3a-a34e-8bfb000cd330 req-2b95850d-040a-400c-bf8c-46a2affe7e70 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036102 Sep 01 16:39:37.549197 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 230/491] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:39:37.732489 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b5981f2e-995d-4892-b2c2-972cf8d2c12c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:37.733205 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-b5981f2e-995d-4892-b2c2-972cf8d2c12c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:37.739720 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b5981f2e-995d-4892-b2c2-972cf8d2c12c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:37.740252 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b5981f2e-995d-4892-b2c2-972cf8d2c12c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:37.740668 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b5981f2e-995d-4892-b2c2-972cf8d2c12c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:37.741358 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b5981f2e-995d-4892-b2c2-972cf8d2c12c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:37.741800 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b5981f2e-995d-4892-b2c2-972cf8d2c12c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:37.742474 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b5981f2e-995d-4892-b2c2-972cf8d2c12c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:37.891974 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b5981f2e-995d-4892-b2c2-972cf8d2c12c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:37.901643 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b5981f2e-995d-4892-b2c2-972cf8d2c12c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:37.903084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b5981f2e-995d-4892-b2c2-972cf8d2c12c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:37.904423 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-b5981f2e-995d-4892-b2c2-972cf8d2c12c tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1810 microversion: 2.20 time: 0.175933 Sep 01 16:39:37.905103 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 262/492] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:37 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1810 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:39:38.540148 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-22388c84-c0d1-4b9f-ab4b-e444ee914601 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:38.540841 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-22388c84-c0d1-4b9f-ab4b-e444ee914601 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 06e1b974-c011-46e9-92bf-1c64c1e07f2e] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:38.548739 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-22388c84-c0d1-4b9f-ab4b-e444ee914601 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:38.549220 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-22388c84-c0d1-4b9f-ab4b-e444ee914601 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:38.549657 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-22388c84-c0d1-4b9f-ab4b-e444ee914601 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:38.550345 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-22388c84-c0d1-4b9f-ab4b-e444ee914601 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:38.550795 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-22388c84-c0d1-4b9f-ab4b-e444ee914601 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:38.551245 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-22388c84-c0d1-4b9f-ab4b-e444ee914601 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:38.568079 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-22388c84-c0d1-4b9f-ab4b-e444ee914601 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] HTTP exception thrown: Instance 06e1b974-c011-46e9-92bf-1c64c1e07f2e could not be found. Sep 01 16:39:38.570185 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-22388c84-c0d1-4b9f-ab4b-e444ee914601 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Request method failure captured: Sep 01 16:39:38.570185 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e HTTP/1.1 Sep 01 16:39:38.570185 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 01 16:39:38.570185 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 01 16:39:38.570185 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Connection: close Sep 01 16:39:38.570185 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 01 16:39:38.570185 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 01 16:39:38.570185 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Host: 10.222.0.62 Sep 01 16:39:38.570185 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 01 16:39:38.570185 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 01 16:39:38.570185 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjEOAo2f5WpyZBOEzz_eCEeP_t-ufTYI17qE832gdyIyD0sxWgpBUkmijbLJ2EsOTXdOa0ctRH9H31KKLL7cSA_TItGlEwIaAD8pFJZvSqpgl05UW3rTy2mU45aS_WNQqAXGNeTnaBBUHNC5z4IASmxYsxEmAb8yVoZukxTYWzJ00dkRM Sep 01 16:39:38.570185 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 01 16:39:38.570185 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 01 16:39:38.570185 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 01 16:39:38.570185 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 01 16:39:38.570185 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 01 16:39:38.570185 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 01 16:39:38.570185 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Id: d23aee15763f4997a71fa7e6864aa4a3 Sep 01 16:39:38.570185 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-VolumesActionsTest-1534741721 Sep 01 16:39:38.570185 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 01 16:39:38.570185 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 01 16:39:38.571616 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d23aee15763f4997a71fa7e6864aa4a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d23aee15763f4997a71fa7e6864aa4a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d23aee15763f4997a71fa7e6864aa4a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d23aee15763f4997a71fa7e6864aa4a3"}]}] Sep 01 16:39:38.571616 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-VolumesActionsTest-1534741721 Sep 01 16:39:38.571616 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Id: d23aee15763f4997a71fa7e6864aa4a3 Sep 01 16:39:38.571616 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-VolumesActionsTest-1534741721 Sep 01 16:39:38.571616 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User: tempest-VolumesActionsTest-1534741721-project Sep 01 16:39:38.571616 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 01 16:39:38.571616 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 01 16:39:38.571616 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Id: 94fa5cd826e24f3992b537e56dc4e1da Sep 01 16:39:38.571616 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-VolumesActionsTest-1534741721-project Sep 01 16:39:38.571616 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: method: > Sep 01 16:39:38.571616 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: exception: Instance 06e1b974-c011-46e9-92bf-1c64c1e07f2e could not be found. Sep 01 16:39:38.571616 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: action_args: {'id': '06e1b974-c011-46e9-92bf-1c64c1e07f2e'} Sep 01 16:39:38.572400 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:39:38.572400 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:39:38.572400 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:39:38.572400 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:39:38.572400 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:39:38.572400 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:39:38.572400 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:39:38.572400 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:39:38.572400 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:39:38.572400 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:39:38.572400 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06e1b974-c011-46e9-92bf-1c64c1e07f2e could not be found. Sep 01 16:39:38.572400 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:39:38.572400 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:39:38.572400 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:39:38.572400 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:39:38.572400 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:39:38.572400 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:39:38.572400 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:39:38.572400 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:39:38.572400 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:39:38.573645 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:39:38.573645 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:39:38.573645 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:39:38.573645 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:39:38.573645 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:39:38.573645 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:39:38.573645 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:39:38.573645 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06e1b974-c011-46e9-92bf-1c64c1e07f2e could not be found. Sep 01 16:39:38.573645 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:39:38.573645 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:39:38.573645 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:39:38.573645 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:39:38.573645 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:39:38.573645 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:39:38.573645 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:39:38.573645 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:39:38.573645 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06e1b974-c011-46e9-92bf-1c64c1e07f2e could not be found. Sep 01 16:39:38.573645 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:39:38.574783 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-22388c84-c0d1-4b9f-ab4b-e444ee914601 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Returning 404 to user: Instance 06e1b974-c011-46e9-92bf-1c64c1e07f2e could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:39:38.574783 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-22388c84-c0d1-4b9f-ab4b-e444ee914601 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e" status: 404 len: 111 microversion: 2.1 time: 0.036264 Sep 01 16:39:38.574783 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 231/493] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:38 2022] GET /compute/v2.1/servers/06e1b974-c011-46e9-92bf-1c64c1e07f2e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:39:38.627913 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-69464d3b-858c-4dbb-a701-1ee744322550 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1179167955", "imageRef": "49e5276c-002c-454f-8be8-76deb18b6b28", "flavorRef": "452", "networks": [{"uuid": "9987aed2-04e9-4e4c-b85b-273e7e9ceb19"}]}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:38.687374 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.network.neutron [None req-69464d3b-858c-4dbb-a701-1ee744322550 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] validate_networks() for [('9987aed2-04e9-4e4c-b85b-273e7e9ceb19', None, None, None, None, None)] {{(pid=127199) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:39:38.930840 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a90651a8-c9ac-4c37-8581-cedbd80eeb15 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:38.931425 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a90651a8-c9ac-4c37-8581-cedbd80eeb15 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:38.938823 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a90651a8-c9ac-4c37-8581-cedbd80eeb15 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:38.939317 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a90651a8-c9ac-4c37-8581-cedbd80eeb15 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:38.939757 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a90651a8-c9ac-4c37-8581-cedbd80eeb15 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:38.940624 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a90651a8-c9ac-4c37-8581-cedbd80eeb15 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:38.941089 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a90651a8-c9ac-4c37-8581-cedbd80eeb15 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:38.941619 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a90651a8-c9ac-4c37-8581-cedbd80eeb15 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:39.127816 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-69464d3b-858c-4dbb-a701-1ee744322550 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Flavor limits 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:39:39.128258 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-69464d3b-858c-4dbb-a701-1ee744322550 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Image limits 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:39:39.128721 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-69464d3b-858c-4dbb-a701-1ee744322550 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Flavor pref 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:39:39.129111 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-69464d3b-858c-4dbb-a701-1ee744322550 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Image pref 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:39:39.129508 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-69464d3b-858c-4dbb-a701-1ee744322550 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:39:39.140373 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-69464d3b-858c-4dbb-a701-1ee744322550 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:39.140875 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-69464d3b-858c-4dbb-a701-1ee744322550 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:39.141301 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-69464d3b-858c-4dbb-a701-1ee744322550 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:39.142029 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-69464d3b-858c-4dbb-a701-1ee744322550 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:39.142524 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-69464d3b-858c-4dbb-a701-1ee744322550 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:39.143145 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-69464d3b-858c-4dbb-a701-1ee744322550 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:39.154413 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a90651a8-c9ac-4c37-8581-cedbd80eeb15 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:39.164222 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-69464d3b-858c-4dbb-a701-1ee744322550 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Getting quotas for project d23aee15763f4997a71fa7e6864aa4a3. Resources: {'ram', 'cores', 'instances'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:39:39.166113 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a90651a8-c9ac-4c37-8581-cedbd80eeb15 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:39.168429 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a90651a8-c9ac-4c37-8581-cedbd80eeb15 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:39.169233 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-69464d3b-858c-4dbb-a701-1ee744322550 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Getting quotas for user 94fa5cd826e24f3992b537e56dc4e1da and project d23aee15763f4997a71fa7e6864aa4a3. Resources: {'ram', 'cores', 'instances'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:39:39.169811 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a90651a8-c9ac-4c37-8581-cedbd80eeb15 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1810 microversion: 2.20 time: 0.242937 Sep 01 16:39:39.170594 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 232/494] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:38 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1810 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:39:39.181175 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-69464d3b-858c-4dbb-a701-1ee744322550 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Going to run 1 instances... {{(pid=127199) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:39:39.183508 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-69464d3b-858c-4dbb-a701-1ee744322550 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 31fe583e-cf41-4d5b-a86f-7947bbab0b0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='49e5276c-002c-454f-8be8-76deb18b6b28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:39:39.231388 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-69464d3b-858c-4dbb-a701-1ee744322550 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.607334 Sep 01 16:39:39.233227 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 263/495] 10.222.0.62 () {60 vars in 1147 bytes} [Thu Sep 1 16:39:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 16:39:39.245363 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8abf5caa-7c38-45a1-9bc7-406c298e337c tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:39.246094 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8abf5caa-7c38-45a1-9bc7-406c298e337c tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 31fe583e-cf41-4d5b-a86f-7947bbab0b0c] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:39.303998 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8abf5caa-7c38-45a1-9bc7-406c298e337c tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fa5cd826e24f3992b537e56dc4e1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23aee15763f4997a71fa7e6864aa4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:39.311743 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8abf5caa-7c38-45a1-9bc7-406c298e337c tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "GET /compute/v2.1/servers/31fe583e-cf41-4d5b-a86f-7947bbab0b0c" status: 200 len: 1214 microversion: 2.1 time: 0.070401 Sep 01 16:39:39.312394 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 233/496] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:39 2022] GET /compute/v2.1/servers/31fe583e-cf41-4d5b-a86f-7947bbab0b0c => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:40.194742 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-78331ecd-1a9f-4c9d-bb4f-267f4e02b623 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:40.196843 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-78331ecd-1a9f-4c9d-bb4f-267f4e02b623 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:40.204500 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-78331ecd-1a9f-4c9d-bb4f-267f4e02b623 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:40.205097 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-78331ecd-1a9f-4c9d-bb4f-267f4e02b623 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:40.205835 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-78331ecd-1a9f-4c9d-bb4f-267f4e02b623 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:40.206688 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-78331ecd-1a9f-4c9d-bb4f-267f4e02b623 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:40.207210 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-78331ecd-1a9f-4c9d-bb4f-267f4e02b623 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:40.207691 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-78331ecd-1a9f-4c9d-bb4f-267f4e02b623 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:40.333049 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-479e999a-e937-438d-8978-dd67d8464e85 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:40.333665 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-479e999a-e937-438d-8978-dd67d8464e85 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 31fe583e-cf41-4d5b-a86f-7947bbab0b0c] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:40.336299 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:40.343247 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-479e999a-e937-438d-8978-dd67d8464e85 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:40.343852 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-479e999a-e937-438d-8978-dd67d8464e85 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:40.344280 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-479e999a-e937-438d-8978-dd67d8464e85 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:40.345163 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-479e999a-e937-438d-8978-dd67d8464e85 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:40.345624 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-479e999a-e937-438d-8978-dd67d8464e85 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:40.346059 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-479e999a-e937-438d-8978-dd67d8464e85 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:40.354485 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-78331ecd-1a9f-4c9d-bb4f-267f4e02b623 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:40.364562 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-78331ecd-1a9f-4c9d-bb4f-267f4e02b623 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:40.366067 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-78331ecd-1a9f-4c9d-bb4f-267f4e02b623 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:40.367537 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-78331ecd-1a9f-4c9d-bb4f-267f4e02b623 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1810 microversion: 2.20 time: 0.177125 Sep 01 16:39:40.368273 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 264/497] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:40 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1810 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:39:40.412367 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-479e999a-e937-438d-8978-dd67d8464e85 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fa5cd826e24f3992b537e56dc4e1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23aee15763f4997a71fa7e6864aa4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:40.420967 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-479e999a-e937-438d-8978-dd67d8464e85 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "GET /compute/v2.1/servers/31fe583e-cf41-4d5b-a86f-7947bbab0b0c" status: 200 len: 1266 microversion: 2.1 time: 0.091745 Sep 01 16:39:40.421896 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 234/498] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:40 2022] GET /compute/v2.1/servers/31fe583e-cf41-4d5b-a86f-7947bbab0b0c => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:41.392627 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-4f060b76-242b-4a3d-b67c-b60816672917 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:41.393224 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-4f060b76-242b-4a3d-b67c-b60816672917 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:41.399814 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4f060b76-242b-4a3d-b67c-b60816672917 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:41.400364 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4f060b76-242b-4a3d-b67c-b60816672917 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:41.400793 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4f060b76-242b-4a3d-b67c-b60816672917 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:41.401496 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4f060b76-242b-4a3d-b67c-b60816672917 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:41.401942 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4f060b76-242b-4a3d-b67c-b60816672917 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:41.402359 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4f060b76-242b-4a3d-b67c-b60816672917 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:41.442583 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-27291ffa-4ec8-499b-973e-7f82202856c4 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:41.443326 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-27291ffa-4ec8-499b-973e-7f82202856c4 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 31fe583e-cf41-4d5b-a86f-7947bbab0b0c] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:41.451481 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-27291ffa-4ec8-499b-973e-7f82202856c4 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:41.452248 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-27291ffa-4ec8-499b-973e-7f82202856c4 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:41.452673 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-27291ffa-4ec8-499b-973e-7f82202856c4 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:41.453412 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-27291ffa-4ec8-499b-973e-7f82202856c4 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:41.453882 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-27291ffa-4ec8-499b-973e-7f82202856c4 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:41.454269 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-27291ffa-4ec8-499b-973e-7f82202856c4 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:41.718301 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-4f060b76-242b-4a3d-b67c-b60816672917 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:41.730210 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-4f060b76-242b-4a3d-b67c-b60816672917 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:41.731749 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-4f060b76-242b-4a3d-b67c-b60816672917 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:41.733486 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-4f060b76-242b-4a3d-b67c-b60816672917 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1810 microversion: 2.20 time: 0.344816 Sep 01 16:39:41.749976 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-27291ffa-4ec8-499b-973e-7f82202856c4 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fa5cd826e24f3992b537e56dc4e1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23aee15763f4997a71fa7e6864aa4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:41.752067 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 265/499] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:41 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1810 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:39:41.759767 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-ceb8c95e-1482-4a54-ad04-21a2eb85d6e2 req-030d6e17-b7c6-41ba-828f-751a0144ee7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ddc2614-8a62-4c61-a086-8dbab65e1f4a", "name": "network-vif-plugged", "status": "completed", "tag": "9d73b218-5a3f-4e30-9685-717b1fbfe797"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:41.762748 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-27291ffa-4ec8-499b-973e-7f82202856c4 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "GET /compute/v2.1/servers/31fe583e-cf41-4d5b-a86f-7947bbab0b0c" status: 200 len: 1314 microversion: 2.1 time: 0.324840 Sep 01 16:39:41.766623 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 235/500] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:41 2022] GET /compute/v2.1/servers/31fe583e-cf41-4d5b-a86f-7947bbab0b0c => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:39:41.778778 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-ceb8c95e-1482-4a54-ad04-21a2eb85d6e2 req-030d6e17-b7c6-41ba-828f-751a0144ee7e service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:41.779747 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-ceb8c95e-1482-4a54-ad04-21a2eb85d6e2 req-030d6e17-b7c6-41ba-828f-751a0144ee7e service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:41.780427 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-ceb8c95e-1482-4a54-ad04-21a2eb85d6e2 req-030d6e17-b7c6-41ba-828f-751a0144ee7e service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:41.797610 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-ceb8c95e-1482-4a54-ad04-21a2eb85d6e2 req-030d6e17-b7c6-41ba-828f-751a0144ee7e service nova] Creating event network-vif-plugged:9d73b218-5a3f-4e30-9685-717b1fbfe797 for instance 8ddc2614-8a62-4c61-a086-8dbab65e1f4a on hv-cinder-85221 Sep 01 16:39:41.804906 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-ceb8c95e-1482-4a54-ad04-21a2eb85d6e2 req-030d6e17-b7c6-41ba-828f-751a0144ee7e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050837 Sep 01 16:39:41.805653 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 266/501] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:39:42.261030 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-1a54d676-3943-4d68-a7b0-a2d76881d1e6 req-df762af3-16b7-4b23-b242-6c728c9558eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31fe583e-cf41-4d5b-a86f-7947bbab0b0c", "tag": "d94286cb-e660-4f23-a0f9-719b91c31927"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:42.282612 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-1a54d676-3943-4d68-a7b0-a2d76881d1e6 req-df762af3-16b7-4b23-b242-6c728c9558eb service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:42.283182 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-1a54d676-3943-4d68-a7b0-a2d76881d1e6 req-df762af3-16b7-4b23-b242-6c728c9558eb service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:42.283638 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-1a54d676-3943-4d68-a7b0-a2d76881d1e6 req-df762af3-16b7-4b23-b242-6c728c9558eb service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:42.299745 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-1a54d676-3943-4d68-a7b0-a2d76881d1e6 req-df762af3-16b7-4b23-b242-6c728c9558eb service nova] Creating event network-changed:d94286cb-e660-4f23-a0f9-719b91c31927 for instance 31fe583e-cf41-4d5b-a86f-7947bbab0b0c on hv-cinder-85221 Sep 01 16:39:42.308607 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-1a54d676-3943-4d68-a7b0-a2d76881d1e6 req-df762af3-16b7-4b23-b242-6c728c9558eb service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049456 Sep 01 16:39:42.311955 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 236/502] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:39:42.759059 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0057afe2-b7f4-4f88-a564-35f6aee6ab99 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:42.759642 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-0057afe2-b7f4-4f88-a564-35f6aee6ab99 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:42.766767 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0057afe2-b7f4-4f88-a564-35f6aee6ab99 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:42.767262 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0057afe2-b7f4-4f88-a564-35f6aee6ab99 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:42.767694 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0057afe2-b7f4-4f88-a564-35f6aee6ab99 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:42.768440 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0057afe2-b7f4-4f88-a564-35f6aee6ab99 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:42.768896 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0057afe2-b7f4-4f88-a564-35f6aee6ab99 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:42.769318 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0057afe2-b7f4-4f88-a564-35f6aee6ab99 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:42.787366 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f28ac1dc-48a7-406b-934c-a4549219b00b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:42.788228 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f28ac1dc-48a7-406b-934c-a4549219b00b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 31fe583e-cf41-4d5b-a86f-7947bbab0b0c] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:42.795163 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f28ac1dc-48a7-406b-934c-a4549219b00b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:42.795784 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f28ac1dc-48a7-406b-934c-a4549219b00b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:42.796390 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f28ac1dc-48a7-406b-934c-a4549219b00b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:42.797190 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f28ac1dc-48a7-406b-934c-a4549219b00b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:42.797758 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f28ac1dc-48a7-406b-934c-a4549219b00b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:42.798318 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f28ac1dc-48a7-406b-934c-a4549219b00b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:43.072433 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-0057afe2-b7f4-4f88-a564-35f6aee6ab99 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:43.079283 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f28ac1dc-48a7-406b-934c-a4549219b00b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fa5cd826e24f3992b537e56dc4e1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23aee15763f4997a71fa7e6864aa4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:43.082687 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-0057afe2-b7f4-4f88-a564-35f6aee6ab99 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:43.084153 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-0057afe2-b7f4-4f88-a564-35f6aee6ab99 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:43.085306 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-0057afe2-b7f4-4f88-a564-35f6aee6ab99 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1810 microversion: 2.20 time: 0.330920 Sep 01 16:39:43.085852 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 267/503] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:42 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1810 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:39:43.087708 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f28ac1dc-48a7-406b-934c-a4549219b00b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "GET /compute/v2.1/servers/31fe583e-cf41-4d5b-a86f-7947bbab0b0c" status: 200 len: 1314 microversion: 2.1 time: 0.304599 Sep 01 16:39:43.088493 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 237/504] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:42 2022] GET /compute/v2.1/servers/31fe583e-cf41-4d5b-a86f-7947bbab0b0c => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:44.108908 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-78538052-9fa7-4b7a-b425-5b671ae62bf4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:44.109620 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-78538052-9fa7-4b7a-b425-5b671ae62bf4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:44.114098 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-eca86bbf-935a-441b-a559-e6a302b28ba2 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:44.114793 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-eca86bbf-935a-441b-a559-e6a302b28ba2 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 31fe583e-cf41-4d5b-a86f-7947bbab0b0c] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:44.116901 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-78538052-9fa7-4b7a-b425-5b671ae62bf4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:44.117365 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-78538052-9fa7-4b7a-b425-5b671ae62bf4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:44.117846 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-78538052-9fa7-4b7a-b425-5b671ae62bf4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:44.119141 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-78538052-9fa7-4b7a-b425-5b671ae62bf4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:44.119141 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-78538052-9fa7-4b7a-b425-5b671ae62bf4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:44.119627 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-78538052-9fa7-4b7a-b425-5b671ae62bf4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:44.123103 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eca86bbf-935a-441b-a559-e6a302b28ba2 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:44.123661 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eca86bbf-935a-441b-a559-e6a302b28ba2 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:44.124324 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eca86bbf-935a-441b-a559-e6a302b28ba2 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:44.125098 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eca86bbf-935a-441b-a559-e6a302b28ba2 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:44.125603 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eca86bbf-935a-441b-a559-e6a302b28ba2 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:44.126077 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eca86bbf-935a-441b-a559-e6a302b28ba2 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:44.329459 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-eca86bbf-935a-441b-a559-e6a302b28ba2 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fa5cd826e24f3992b537e56dc4e1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23aee15763f4997a71fa7e6864aa4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:44.333196 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-78538052-9fa7-4b7a-b425-5b671ae62bf4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:44.337647 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-eca86bbf-935a-441b-a559-e6a302b28ba2 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "GET /compute/v2.1/servers/31fe583e-cf41-4d5b-a86f-7947bbab0b0c" status: 200 len: 1314 microversion: 2.1 time: 0.228252 Sep 01 16:39:44.338239 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 238/505] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:44 2022] GET /compute/v2.1/servers/31fe583e-cf41-4d5b-a86f-7947bbab0b0c => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:44.346769 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-78538052-9fa7-4b7a-b425-5b671ae62bf4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:44.348229 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-78538052-9fa7-4b7a-b425-5b671ae62bf4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:44.349453 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-78538052-9fa7-4b7a-b425-5b671ae62bf4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1810 microversion: 2.20 time: 0.244998 Sep 01 16:39:44.349989 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 268/506] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:44 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1810 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:39:45.360207 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-065dc0de-080d-4130-b423-3c1ef398661b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:45.360808 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-065dc0de-080d-4130-b423-3c1ef398661b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 31fe583e-cf41-4d5b-a86f-7947bbab0b0c] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:45.367330 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-065dc0de-080d-4130-b423-3c1ef398661b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:45.367824 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-065dc0de-080d-4130-b423-3c1ef398661b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:45.368291 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-065dc0de-080d-4130-b423-3c1ef398661b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:45.368968 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-065dc0de-080d-4130-b423-3c1ef398661b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:45.369422 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-065dc0de-080d-4130-b423-3c1ef398661b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:45.369840 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-065dc0de-080d-4130-b423-3c1ef398661b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:45.382914 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-1bc9d33c-30ef-42e8-be3a-0f13758e6d6a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:45.383613 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-1bc9d33c-30ef-42e8-be3a-0f13758e6d6a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:45.390561 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1bc9d33c-30ef-42e8-be3a-0f13758e6d6a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:45.391054 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1bc9d33c-30ef-42e8-be3a-0f13758e6d6a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:45.391484 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1bc9d33c-30ef-42e8-be3a-0f13758e6d6a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:45.392307 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1bc9d33c-30ef-42e8-be3a-0f13758e6d6a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:45.392762 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1bc9d33c-30ef-42e8-be3a-0f13758e6d6a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:45.393182 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1bc9d33c-30ef-42e8-be3a-0f13758e6d6a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:45.643378 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-065dc0de-080d-4130-b423-3c1ef398661b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fa5cd826e24f3992b537e56dc4e1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23aee15763f4997a71fa7e6864aa4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:45.651209 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-065dc0de-080d-4130-b423-3c1ef398661b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "GET /compute/v2.1/servers/31fe583e-cf41-4d5b-a86f-7947bbab0b0c" status: 200 len: 1314 microversion: 2.1 time: 0.294988 Sep 01 16:39:45.651918 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 239/507] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:45 2022] GET /compute/v2.1/servers/31fe583e-cf41-4d5b-a86f-7947bbab0b0c => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:45.658635 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-1bc9d33c-30ef-42e8-be3a-0f13758e6d6a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:45.667909 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-1bc9d33c-30ef-42e8-be3a-0f13758e6d6a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:45.669389 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-1bc9d33c-30ef-42e8-be3a-0f13758e6d6a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:45.670664 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-1bc9d33c-30ef-42e8-be3a-0f13758e6d6a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1810 microversion: 2.20 time: 0.292002 Sep 01 16:39:45.671218 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 269/508] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:45 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1810 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:39:46.675313 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d0d43839-c455-48ca-8f71-83765dd2d072 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:46.676079 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d0d43839-c455-48ca-8f71-83765dd2d072 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 31fe583e-cf41-4d5b-a86f-7947bbab0b0c] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:46.683568 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d0d43839-c455-48ca-8f71-83765dd2d072 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:46.684125 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d0d43839-c455-48ca-8f71-83765dd2d072 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:46.684570 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d0d43839-c455-48ca-8f71-83765dd2d072 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:46.685286 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d0d43839-c455-48ca-8f71-83765dd2d072 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:46.686030 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d0d43839-c455-48ca-8f71-83765dd2d072 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:46.686867 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d0d43839-c455-48ca-8f71-83765dd2d072 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:46.689559 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:46.694653 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-71a8855a-0cab-4783-a33c-bbbadd9a47c1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:46.695246 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-71a8855a-0cab-4783-a33c-bbbadd9a47c1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:46.701767 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-71a8855a-0cab-4783-a33c-bbbadd9a47c1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:46.702249 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-71a8855a-0cab-4783-a33c-bbbadd9a47c1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:46.702687 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-71a8855a-0cab-4783-a33c-bbbadd9a47c1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:46.703394 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-71a8855a-0cab-4783-a33c-bbbadd9a47c1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:46.703921 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-71a8855a-0cab-4783-a33c-bbbadd9a47c1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:46.704287 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-71a8855a-0cab-4783-a33c-bbbadd9a47c1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:46.897163 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d0d43839-c455-48ca-8f71-83765dd2d072 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fa5cd826e24f3992b537e56dc4e1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23aee15763f4997a71fa7e6864aa4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:46.904125 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-71a8855a-0cab-4783-a33c-bbbadd9a47c1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:46.905067 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d0d43839-c455-48ca-8f71-83765dd2d072 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "GET /compute/v2.1/servers/31fe583e-cf41-4d5b-a86f-7947bbab0b0c" status: 200 len: 1314 microversion: 2.1 time: 0.234998 Sep 01 16:39:46.905689 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 240/509] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:46 2022] GET /compute/v2.1/servers/31fe583e-cf41-4d5b-a86f-7947bbab0b0c => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:46.913596 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-71a8855a-0cab-4783-a33c-bbbadd9a47c1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:46.915044 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-71a8855a-0cab-4783-a33c-bbbadd9a47c1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:46.916265 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-71a8855a-0cab-4783-a33c-bbbadd9a47c1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1797 microversion: 2.20 time: 0.225985 Sep 01 16:39:46.916818 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 270/510] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:46 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1797 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:39:47.926164 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8fbb0d12-863c-4eb4-a632-ec94605c8870 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:47.926850 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8fbb0d12-863c-4eb4-a632-ec94605c8870 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 31fe583e-cf41-4d5b-a86f-7947bbab0b0c] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:47.934150 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8fbb0d12-863c-4eb4-a632-ec94605c8870 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:47.935292 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8fbb0d12-863c-4eb4-a632-ec94605c8870 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:47.935958 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8fbb0d12-863c-4eb4-a632-ec94605c8870 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:47.936702 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8fbb0d12-863c-4eb4-a632-ec94605c8870 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:47.937466 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8fbb0d12-863c-4eb4-a632-ec94605c8870 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:47.937718 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8fbb0d12-863c-4eb4-a632-ec94605c8870 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:48.093090 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8fbb0d12-863c-4eb4-a632-ec94605c8870 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fa5cd826e24f3992b537e56dc4e1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23aee15763f4997a71fa7e6864aa4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:48.101459 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8fbb0d12-863c-4eb4-a632-ec94605c8870 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "GET /compute/v2.1/servers/31fe583e-cf41-4d5b-a86f-7947bbab0b0c" status: 200 len: 1314 microversion: 2.1 time: 0.179397 Sep 01 16:39:48.101967 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 241/511] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:47 2022] GET /compute/v2.1/servers/31fe583e-cf41-4d5b-a86f-7947bbab0b0c => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:49.125526 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ac2e1310-bd8c-454f-869c-eb0c89f382d6 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:49.126270 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ac2e1310-bd8c-454f-869c-eb0c89f382d6 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 31fe583e-cf41-4d5b-a86f-7947bbab0b0c] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:49.135731 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac2e1310-bd8c-454f-869c-eb0c89f382d6 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:49.136573 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac2e1310-bd8c-454f-869c-eb0c89f382d6 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:49.137233 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac2e1310-bd8c-454f-869c-eb0c89f382d6 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:49.138315 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac2e1310-bd8c-454f-869c-eb0c89f382d6 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:49.139181 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac2e1310-bd8c-454f-869c-eb0c89f382d6 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:49.139854 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac2e1310-bd8c-454f-869c-eb0c89f382d6 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:49.157634 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=2 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:49.176325 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=6 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:49.286405 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ac2e1310-bd8c-454f-869c-eb0c89f382d6 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fa5cd826e24f3992b537e56dc4e1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23aee15763f4997a71fa7e6864aa4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:49.294321 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ac2e1310-bd8c-454f-869c-eb0c89f382d6 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "GET /compute/v2.1/servers/31fe583e-cf41-4d5b-a86f-7947bbab0b0c" status: 200 len: 1314 microversion: 2.1 time: 0.174465 Sep 01 16:39:49.294930 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 271/512] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:49 2022] GET /compute/v2.1/servers/31fe583e-cf41-4d5b-a86f-7947bbab0b0c => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:49.765191 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-b183cda4-9678-4abf-91ca-3f61f47b8bde req-b733bfc8-2b62-4743-b48b-dbf7793d0398 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31fe583e-cf41-4d5b-a86f-7947bbab0b0c", "name": "network-vif-plugged", "status": "completed", "tag": "d94286cb-e660-4f23-a0f9-719b91c31927"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:49.770982 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:49.778240 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-b183cda4-9678-4abf-91ca-3f61f47b8bde req-b733bfc8-2b62-4743-b48b-dbf7793d0398 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:49.778724 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-b183cda4-9678-4abf-91ca-3f61f47b8bde req-b733bfc8-2b62-4743-b48b-dbf7793d0398 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:49.779154 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-b183cda4-9678-4abf-91ca-3f61f47b8bde req-b733bfc8-2b62-4743-b48b-dbf7793d0398 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:49.790812 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-b183cda4-9678-4abf-91ca-3f61f47b8bde req-b733bfc8-2b62-4743-b48b-dbf7793d0398 service nova] Creating event network-vif-plugged:d94286cb-e660-4f23-a0f9-719b91c31927 for instance 31fe583e-cf41-4d5b-a86f-7947bbab0b0c on hv-cinder-85221 Sep 01 16:39:49.795691 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-b183cda4-9678-4abf-91ca-3f61f47b8bde req-b733bfc8-2b62-4743-b48b-dbf7793d0398 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034220 Sep 01 16:39:49.796432 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 242/513] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:39:50.324629 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-eae58056-08c8-4705-a381-96f894ea3c83 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:50.326125 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-eae58056-08c8-4705-a381-96f894ea3c83 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 31fe583e-cf41-4d5b-a86f-7947bbab0b0c] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:50.329814 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:50.339643 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eae58056-08c8-4705-a381-96f894ea3c83 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:50.340759 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eae58056-08c8-4705-a381-96f894ea3c83 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:50.341557 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eae58056-08c8-4705-a381-96f894ea3c83 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:50.342687 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eae58056-08c8-4705-a381-96f894ea3c83 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:50.343143 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eae58056-08c8-4705-a381-96f894ea3c83 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:50.343588 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eae58056-08c8-4705-a381-96f894ea3c83 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:50.509177 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-eae58056-08c8-4705-a381-96f894ea3c83 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fa5cd826e24f3992b537e56dc4e1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23aee15763f4997a71fa7e6864aa4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:50.517267 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-eae58056-08c8-4705-a381-96f894ea3c83 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "GET /compute/v2.1/servers/31fe583e-cf41-4d5b-a86f-7947bbab0b0c" status: 200 len: 1314 microversion: 2.1 time: 0.198080 Sep 01 16:39:50.517872 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 272/514] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:50 2022] GET /compute/v2.1/servers/31fe583e-cf41-4d5b-a86f-7947bbab0b0c => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:51.540044 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e919fd40-af2f-4aec-b8dc-3ef5fd5f739d tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:51.540753 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e919fd40-af2f-4aec-b8dc-3ef5fd5f739d tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 31fe583e-cf41-4d5b-a86f-7947bbab0b0c] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:51.547253 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e919fd40-af2f-4aec-b8dc-3ef5fd5f739d tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:51.547731 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e919fd40-af2f-4aec-b8dc-3ef5fd5f739d tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:51.548190 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e919fd40-af2f-4aec-b8dc-3ef5fd5f739d tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:51.548871 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e919fd40-af2f-4aec-b8dc-3ef5fd5f739d tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:51.549318 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e919fd40-af2f-4aec-b8dc-3ef5fd5f739d tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:51.549734 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e919fd40-af2f-4aec-b8dc-3ef5fd5f739d tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:51.708944 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e919fd40-af2f-4aec-b8dc-3ef5fd5f739d tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fa5cd826e24f3992b537e56dc4e1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23aee15763f4997a71fa7e6864aa4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:51.716959 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e919fd40-af2f-4aec-b8dc-3ef5fd5f739d tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "GET /compute/v2.1/servers/31fe583e-cf41-4d5b-a86f-7947bbab0b0c" status: 200 len: 1314 microversion: 2.1 time: 0.181745 Sep 01 16:39:51.717559 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 243/515] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:51 2022] GET /compute/v2.1/servers/31fe583e-cf41-4d5b-a86f-7947bbab0b0c => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:52.745034 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8ef3a961-d34b-4dc3-aa39-2e6f6ed8752a tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:52.745811 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-8ef3a961-d34b-4dc3-aa39-2e6f6ed8752a tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 31fe583e-cf41-4d5b-a86f-7947bbab0b0c] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:52.754726 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8ef3a961-d34b-4dc3-aa39-2e6f6ed8752a tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:52.755283 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8ef3a961-d34b-4dc3-aa39-2e6f6ed8752a tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:52.755715 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8ef3a961-d34b-4dc3-aa39-2e6f6ed8752a tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:52.756526 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8ef3a961-d34b-4dc3-aa39-2e6f6ed8752a tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:52.756900 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8ef3a961-d34b-4dc3-aa39-2e6f6ed8752a tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:52.757317 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8ef3a961-d34b-4dc3-aa39-2e6f6ed8752a tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:52.901470 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8ef3a961-d34b-4dc3-aa39-2e6f6ed8752a tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fa5cd826e24f3992b537e56dc4e1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23aee15763f4997a71fa7e6864aa4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:52.913950 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8ef3a961-d34b-4dc3-aa39-2e6f6ed8752a tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "GET /compute/v2.1/servers/31fe583e-cf41-4d5b-a86f-7947bbab0b0c" status: 200 len: 1497 microversion: 2.1 time: 0.172904 Sep 01 16:39:52.914785 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 273/516] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:52 2022] GET /compute/v2.1/servers/31fe583e-cf41-4d5b-a86f-7947bbab0b0c => generated 1497 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:53.446390 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-4b2e15b3-d8b5-4f64-b9f0-dfe6de84948a tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:53.447029 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-4b2e15b3-d8b5-4f64-b9f0-dfe6de84948a tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 31fe583e-cf41-4d5b-a86f-7947bbab0b0c] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:53.454388 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4b2e15b3-d8b5-4f64-b9f0-dfe6de84948a tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:53.454876 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4b2e15b3-d8b5-4f64-b9f0-dfe6de84948a tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:53.455342 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4b2e15b3-d8b5-4f64-b9f0-dfe6de84948a tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:53.456072 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4b2e15b3-d8b5-4f64-b9f0-dfe6de84948a tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:53.456532 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4b2e15b3-d8b5-4f64-b9f0-dfe6de84948a tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:53.456954 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4b2e15b3-d8b5-4f64-b9f0-dfe6de84948a tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:53.482972 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-4b2e15b3-d8b5-4f64-b9f0-dfe6de84948a tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 31fe583e-cf41-4d5b-a86f-7947bbab0b0c] Going to try to terminate instance {{(pid=127198) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:39:53.564518 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-4b2e15b3-d8b5-4f64-b9f0-dfe6de84948a tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "DELETE /compute/v2.1/servers/31fe583e-cf41-4d5b-a86f-7947bbab0b0c" status: 204 len: 0 microversion: 2.1 time: 0.121524 Sep 01 16:39:53.565487 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 244/517] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Sep 1 16:39:53 2022] DELETE /compute/v2.1/servers/31fe583e-cf41-4d5b-a86f-7947bbab0b0c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:39:53.588387 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8534ad79-48c2-4434-b910-4381591356a5 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:53.588995 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-8534ad79-48c2-4434-b910-4381591356a5 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 31fe583e-cf41-4d5b-a86f-7947bbab0b0c] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:53.595571 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8534ad79-48c2-4434-b910-4381591356a5 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:53.596094 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8534ad79-48c2-4434-b910-4381591356a5 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:53.596570 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8534ad79-48c2-4434-b910-4381591356a5 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:53.597257 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8534ad79-48c2-4434-b910-4381591356a5 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:53.597695 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8534ad79-48c2-4434-b910-4381591356a5 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:53.598107 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8534ad79-48c2-4434-b910-4381591356a5 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:53.740356 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8534ad79-48c2-4434-b910-4381591356a5 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fa5cd826e24f3992b537e56dc4e1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23aee15763f4997a71fa7e6864aa4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:53.751013 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8534ad79-48c2-4434-b910-4381591356a5 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "GET /compute/v2.1/servers/31fe583e-cf41-4d5b-a86f-7947bbab0b0c" status: 200 len: 1503 microversion: 2.1 time: 0.180824 Sep 01 16:39:53.751629 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 274/518] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:53 2022] GET /compute/v2.1/servers/31fe583e-cf41-4d5b-a86f-7947bbab0b0c => generated 1503 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:54.081677 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-201601f5-87fa-477b-a76b-a1bddad130c1 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:54.082525 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-201601f5-87fa-477b-a76b-a1bddad130c1 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:54.091291 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-201601f5-87fa-477b-a76b-a1bddad130c1 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:54.092248 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-201601f5-87fa-477b-a76b-a1bddad130c1 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:54.092770 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-201601f5-87fa-477b-a76b-a1bddad130c1 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:54.093469 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-201601f5-87fa-477b-a76b-a1bddad130c1 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:54.093931 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-201601f5-87fa-477b-a76b-a1bddad130c1 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:54.094357 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-201601f5-87fa-477b-a76b-a1bddad130c1 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:54.237146 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-201601f5-87fa-477b-a76b-a1bddad130c1 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lazy-loading 'services' on Instance uuid a1bf96dd-b79a-403b-aa81-985c692df037 {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:39:54.369120 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-201601f5-87fa-477b-a76b-a1bddad130c1 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037/os-volume_attachments/61cd3bef-c32f-408d-b7ee-fdd8ba47e125" status: 202 len: 0 microversion: 2.1 time: 0.294306 Sep 01 16:39:54.369732 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 245/519] 10.222.0.62 () {58 vars in 1416 bytes} [Thu Sep 1 16:39:54 2022] DELETE /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037/os-volume_attachments/61cd3bef-c32f-408d-b7ee-fdd8ba47e125 => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:39:54.775113 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-5b0dba8b-0279-48b8-877c-bacb02f2a8a9 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:54.775746 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-5b0dba8b-0279-48b8-877c-bacb02f2a8a9 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 31fe583e-cf41-4d5b-a86f-7947bbab0b0c] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:54.783357 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5b0dba8b-0279-48b8-877c-bacb02f2a8a9 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:54.783869 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5b0dba8b-0279-48b8-877c-bacb02f2a8a9 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:54.784324 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5b0dba8b-0279-48b8-877c-bacb02f2a8a9 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:54.785018 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5b0dba8b-0279-48b8-877c-bacb02f2a8a9 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:54.785470 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5b0dba8b-0279-48b8-877c-bacb02f2a8a9 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:54.785887 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5b0dba8b-0279-48b8-877c-bacb02f2a8a9 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:54.928136 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-5b0dba8b-0279-48b8-877c-bacb02f2a8a9 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fa5cd826e24f3992b537e56dc4e1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23aee15763f4997a71fa7e6864aa4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:54.936629 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-5b0dba8b-0279-48b8-877c-bacb02f2a8a9 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "GET /compute/v2.1/servers/31fe583e-cf41-4d5b-a86f-7947bbab0b0c" status: 200 len: 1503 microversion: 2.1 time: 0.166535 Sep 01 16:39:54.937201 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 275/520] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:54 2022] GET /compute/v2.1/servers/31fe583e-cf41-4d5b-a86f-7947bbab0b0c => generated 1503 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:55.958548 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-53d9c5ca-e050-41b5-925f-7355aa1ede89 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:55.959121 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-fd2cd5c3-9387-4448-ba72-3db7532692ac req-f8e88613-d981-482c-8c8e-7e93b5d71cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31fe583e-cf41-4d5b-a86f-7947bbab0b0c", "name": "network-vif-deleted", "tag": "d94286cb-e660-4f23-a0f9-719b91c31927"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:55.959528 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-53d9c5ca-e050-41b5-925f-7355aa1ede89 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 31fe583e-cf41-4d5b-a86f-7947bbab0b0c] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:55.966476 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-53d9c5ca-e050-41b5-925f-7355aa1ede89 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:55.966958 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-53d9c5ca-e050-41b5-925f-7355aa1ede89 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:55.967418 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-53d9c5ca-e050-41b5-925f-7355aa1ede89 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:55.968270 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-53d9c5ca-e050-41b5-925f-7355aa1ede89 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:55.968965 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-53d9c5ca-e050-41b5-925f-7355aa1ede89 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:55.969564 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-53d9c5ca-e050-41b5-925f-7355aa1ede89 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:55.973052 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-fd2cd5c3-9387-4448-ba72-3db7532692ac req-f8e88613-d981-482c-8c8e-7e93b5d71cb5 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:55.973523 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-fd2cd5c3-9387-4448-ba72-3db7532692ac req-f8e88613-d981-482c-8c8e-7e93b5d71cb5 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:55.973944 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-fd2cd5c3-9387-4448-ba72-3db7532692ac req-f8e88613-d981-482c-8c8e-7e93b5d71cb5 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:55.987049 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-fd2cd5c3-9387-4448-ba72-3db7532692ac req-f8e88613-d981-482c-8c8e-7e93b5d71cb5 service nova] Creating event network-vif-deleted:d94286cb-e660-4f23-a0f9-719b91c31927 for instance 31fe583e-cf41-4d5b-a86f-7947bbab0b0c on hv-cinder-85221 Sep 01 16:39:55.994258 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-fd2cd5c3-9387-4448-ba72-3db7532692ac req-f8e88613-d981-482c-8c8e-7e93b5d71cb5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039771 Sep 01 16:39:55.994884 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 276/521] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:39:56.049541 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-53d9c5ca-e050-41b5-925f-7355aa1ede89 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94fa5cd826e24f3992b537e56dc4e1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23aee15763f4997a71fa7e6864aa4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:56.058971 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-53d9c5ca-e050-41b5-925f-7355aa1ede89 tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "GET /compute/v2.1/servers/31fe583e-cf41-4d5b-a86f-7947bbab0b0c" status: 200 len: 1461 microversion: 2.1 time: 0.105199 Sep 01 16:39:56.059554 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 246/522] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:55 2022] GET /compute/v2.1/servers/31fe583e-cf41-4d5b-a86f-7947bbab0b0c => generated 1461 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:56.574978 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-894c9821-04b7-4404-a8fe-7aa55c85a4c5 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:56.582691 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-894c9821-04b7-4404-a8fe-7aa55c85a4c5 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:56.583186 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-894c9821-04b7-4404-a8fe-7aa55c85a4c5 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:56.583619 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-894c9821-04b7-4404-a8fe-7aa55c85a4c5 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:56.607200 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-894c9821-04b7-4404-a8fe-7aa55c85a4c5 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Going to try to stop instance {{(pid=127199) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 16:39:56.642025 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:56.656754 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-894c9821-04b7-4404-a8fe-7aa55c85a4c5 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "POST /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037/action" status: 202 len: 0 microversion: 2.1 time: 0.085374 Sep 01 16:39:56.657702 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 277/523] 10.222.0.62 () {60 vars in 1278 bytes} [Thu Sep 1 16:39:56 2022] POST /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:39:56.666061 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-80ba6600-1a66-45d9-a8a2-a86e768a92ad tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:56.666993 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-80ba6600-1a66-45d9-a8a2-a86e768a92ad tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:56.673678 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-80ba6600-1a66-45d9-a8a2-a86e768a92ad tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:56.674513 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-80ba6600-1a66-45d9-a8a2-a86e768a92ad tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:56.675027 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-80ba6600-1a66-45d9-a8a2-a86e768a92ad tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:56.675733 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-80ba6600-1a66-45d9-a8a2-a86e768a92ad tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:56.676202 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-80ba6600-1a66-45d9-a8a2-a86e768a92ad tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:56.676767 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-80ba6600-1a66-45d9-a8a2-a86e768a92ad tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:56.826140 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-80ba6600-1a66-45d9-a8a2-a86e768a92ad tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:56.834433 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-80ba6600-1a66-45d9-a8a2-a86e768a92ad tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1676 microversion: 2.1 time: 0.172325 Sep 01 16:39:56.835020 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 247/524] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:56 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1676 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:57.082320 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-378a184f-7191-4129-b024-2f64e5295b3b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:57.083023 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-378a184f-7191-4129-b024-2f64e5295b3b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] [instance: 31fe583e-cf41-4d5b-a86f-7947bbab0b0c] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:57.090575 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-378a184f-7191-4129-b024-2f64e5295b3b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:57.091189 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-378a184f-7191-4129-b024-2f64e5295b3b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:57.091826 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-378a184f-7191-4129-b024-2f64e5295b3b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:57.093775 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-378a184f-7191-4129-b024-2f64e5295b3b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:57.093775 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-378a184f-7191-4129-b024-2f64e5295b3b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:57.093775 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-378a184f-7191-4129-b024-2f64e5295b3b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:57.108146 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-378a184f-7191-4129-b024-2f64e5295b3b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] HTTP exception thrown: Instance 31fe583e-cf41-4d5b-a86f-7947bbab0b0c could not be found. Sep 01 16:39:57.109825 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-378a184f-7191-4129-b024-2f64e5295b3b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Request method failure captured: Sep 01 16:39:57.109825 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: request: GET /compute/v2.1/servers/31fe583e-cf41-4d5b-a86f-7947bbab0b0c HTTP/1.1 Sep 01 16:39:57.109825 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 01 16:39:57.109825 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 01 16:39:57.109825 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Connection: close Sep 01 16:39:57.109825 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 01 16:39:57.109825 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 01 16:39:57.109825 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Host: 10.222.0.62 Sep 01 16:39:57.109825 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 01 16:39:57.109825 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 01 16:39:57.109825 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjEOAo2f5WpyZBOEzz_eCEeP_t-ufTYI17qE832gdyIyD0sxWgpBUkmijbLJ2EsOTXdOa0ctRH9H31KKLL7cSA_TItGlEwIaAD8pFJZvSqpgl05UW3rTy2mU45aS_WNQqAXGNeTnaBBUHNC5z4IASmxYsxEmAb8yVoZukxTYWzJ00dkRM Sep 01 16:39:57.109825 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 01 16:39:57.109825 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 01 16:39:57.109825 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 01 16:39:57.109825 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 01 16:39:57.109825 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 01 16:39:57.109825 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 01 16:39:57.109825 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Id: d23aee15763f4997a71fa7e6864aa4a3 Sep 01 16:39:57.109825 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-VolumesActionsTest-1534741721 Sep 01 16:39:57.109825 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 01 16:39:57.109825 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 01 16:39:57.111301 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d23aee15763f4997a71fa7e6864aa4a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d23aee15763f4997a71fa7e6864aa4a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d23aee15763f4997a71fa7e6864aa4a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d23aee15763f4997a71fa7e6864aa4a3"}]}] Sep 01 16:39:57.111301 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-VolumesActionsTest-1534741721 Sep 01 16:39:57.111301 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Id: d23aee15763f4997a71fa7e6864aa4a3 Sep 01 16:39:57.111301 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-VolumesActionsTest-1534741721 Sep 01 16:39:57.111301 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User: tempest-VolumesActionsTest-1534741721-project Sep 01 16:39:57.111301 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 01 16:39:57.111301 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 01 16:39:57.111301 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Id: 94fa5cd826e24f3992b537e56dc4e1da Sep 01 16:39:57.111301 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-VolumesActionsTest-1534741721-project Sep 01 16:39:57.111301 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: method: > Sep 01 16:39:57.111301 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: exception: Instance 31fe583e-cf41-4d5b-a86f-7947bbab0b0c could not be found. Sep 01 16:39:57.111301 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: action_args: {'id': '31fe583e-cf41-4d5b-a86f-7947bbab0b0c'} Sep 01 16:39:57.112244 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:39:57.112244 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:39:57.112244 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:39:57.112244 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:39:57.112244 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:39:57.112244 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:39:57.112244 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:39:57.112244 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:39:57.112244 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:39:57.112244 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:39:57.112244 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31fe583e-cf41-4d5b-a86f-7947bbab0b0c could not be found. Sep 01 16:39:57.112244 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:39:57.112244 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:39:57.112244 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:39:57.112244 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:39:57.112244 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:39:57.112244 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:39:57.112244 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:39:57.112244 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:39:57.112244 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:39:57.113657 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:39:57.113657 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:39:57.113657 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:39:57.113657 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:39:57.113657 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:39:57.113657 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:39:57.113657 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:39:57.113657 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31fe583e-cf41-4d5b-a86f-7947bbab0b0c could not be found. Sep 01 16:39:57.113657 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:39:57.113657 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:39:57.113657 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:39:57.113657 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:39:57.113657 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:39:57.113657 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:39:57.113657 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:39:57.113657 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:39:57.113657 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31fe583e-cf41-4d5b-a86f-7947bbab0b0c could not be found. Sep 01 16:39:57.113657 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:39:57.115029 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-378a184f-7191-4129-b024-2f64e5295b3b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] Returning 404 to user: Instance 31fe583e-cf41-4d5b-a86f-7947bbab0b0c could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:39:57.115029 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-378a184f-7191-4129-b024-2f64e5295b3b tempest-VolumesActionsTest-1534741721 tempest-VolumesActionsTest-1534741721-project] 10.222.0.62 "GET /compute/v2.1/servers/31fe583e-cf41-4d5b-a86f-7947bbab0b0c" status: 404 len: 111 microversion: 2.1 time: 0.033673 Sep 01 16:39:57.115029 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 278/525] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:57 2022] GET /compute/v2.1/servers/31fe583e-cf41-4d5b-a86f-7947bbab0b0c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:39:57.856616 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6c189f09-c3df-4200-a409-ae0d8754ae21 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:57.857238 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-6c189f09-c3df-4200-a409-ae0d8754ae21 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:57.865334 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6c189f09-c3df-4200-a409-ae0d8754ae21 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:57.865681 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6c189f09-c3df-4200-a409-ae0d8754ae21 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:57.865905 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6c189f09-c3df-4200-a409-ae0d8754ae21 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:57.866643 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6c189f09-c3df-4200-a409-ae0d8754ae21 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:57.867074 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6c189f09-c3df-4200-a409-ae0d8754ae21 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:57.867512 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6c189f09-c3df-4200-a409-ae0d8754ae21 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:58.011279 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-6c189f09-c3df-4200-a409-ae0d8754ae21 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:58.021105 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-6c189f09-c3df-4200-a409-ae0d8754ae21 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1676 microversion: 2.1 time: 0.170150 Sep 01 16:39:58.021706 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 248/526] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:57 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:59.043638 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-59c875cc-9904-4352-b756-24579a2486bf tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:59.045368 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-59c875cc-9904-4352-b756-24579a2486bf tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:59.050671 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-59c875cc-9904-4352-b756-24579a2486bf tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:59.051147 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-59c875cc-9904-4352-b756-24579a2486bf tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:59.051572 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-59c875cc-9904-4352-b756-24579a2486bf tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:59.052290 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-59c875cc-9904-4352-b756-24579a2486bf tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:59.052737 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-59c875cc-9904-4352-b756-24579a2486bf tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:59.053143 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-59c875cc-9904-4352-b756-24579a2486bf tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:59.209378 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-59c875cc-9904-4352-b756-24579a2486bf tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:59.220588 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-59c875cc-9904-4352-b756-24579a2486bf tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1676 microversion: 2.1 time: 0.181105 Sep 01 16:39:59.221135 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 279/527] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:59 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1676 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:59.836592 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ea4bc7a9-ca7b-4270-9ca9-4faa60c2eb89 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d2778d3-fed1-443a-9216-1350fc7e81b1"}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:59.839202 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ea4bc7a9-ca7b-4270-9ca9-4faa60c2eb89 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:59.846810 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ea4bc7a9-ca7b-4270-9ca9-4faa60c2eb89 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:59.847311 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ea4bc7a9-ca7b-4270-9ca9-4faa60c2eb89 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:59.847746 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ea4bc7a9-ca7b-4270-9ca9-4faa60c2eb89 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:59.848519 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ea4bc7a9-ca7b-4270-9ca9-4faa60c2eb89 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:59.848966 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ea4bc7a9-ca7b-4270-9ca9-4faa60c2eb89 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:59.849398 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ea4bc7a9-ca7b-4270-9ca9-4faa60c2eb89 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:00.241192 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d52c1145-464e-4b4b-a5b6-6889f7d49acc tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:00.241834 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d52c1145-464e-4b4b-a5b6-6889f7d49acc tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:00.248537 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d52c1145-464e-4b4b-a5b6-6889f7d49acc tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:00.249050 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d52c1145-464e-4b4b-a5b6-6889f7d49acc tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:00.249485 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d52c1145-464e-4b4b-a5b6-6889f7d49acc tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:00.250470 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d52c1145-464e-4b4b-a5b6-6889f7d49acc tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:00.250943 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d52c1145-464e-4b4b-a5b6-6889f7d49acc tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:00.251350 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d52c1145-464e-4b4b-a5b6-6889f7d49acc tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:00.393684 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d52c1145-464e-4b4b-a5b6-6889f7d49acc tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:00.401953 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d52c1145-464e-4b4b-a5b6-6889f7d49acc tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1676 microversion: 2.1 time: 0.164717 Sep 01 16:40:00.402518 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 280/528] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:00 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:00.976876 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ea4bc7a9-ca7b-4270-9ca9-4faa60c2eb89 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "POST /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.144984 Sep 01 16:40:00.977558 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 249/529] 10.222.0.62 () {60 vars in 1323 bytes} [Thu Sep 1 16:39:59 2022] POST /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859/os-volume_attachments => generated 194 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:40:01.424698 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-6905e620-1395-4bb3-a6b0-f44635799ee9 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:01.425325 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-6905e620-1395-4bb3-a6b0-f44635799ee9 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:01.432562 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6905e620-1395-4bb3-a6b0-f44635799ee9 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:01.433080 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6905e620-1395-4bb3-a6b0-f44635799ee9 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:01.433522 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6905e620-1395-4bb3-a6b0-f44635799ee9 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:01.434241 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6905e620-1395-4bb3-a6b0-f44635799ee9 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:01.434692 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6905e620-1395-4bb3-a6b0-f44635799ee9 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:01.435113 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6905e620-1395-4bb3-a6b0-f44635799ee9 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:01.580097 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-6905e620-1395-4bb3-a6b0-f44635799ee9 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:01.588344 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-6905e620-1395-4bb3-a6b0-f44635799ee9 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1676 microversion: 2.1 time: 0.168179 Sep 01 16:40:01.588939 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 281/530] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:01 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:02.008412 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6834cc24-e1d7-4246-a6b4-279a1140325d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:02.009271 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-6834cc24-e1d7-4246-a6b4-279a1140325d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: c22c916b-390e-4bfe-8529-695bac5e5629] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:02.017362 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6834cc24-e1d7-4246-a6b4-279a1140325d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:02.017806 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6834cc24-e1d7-4246-a6b4-279a1140325d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:02.018228 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6834cc24-e1d7-4246-a6b4-279a1140325d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:02.018940 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6834cc24-e1d7-4246-a6b4-279a1140325d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:02.019388 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6834cc24-e1d7-4246-a6b4-279a1140325d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:02.020023 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6834cc24-e1d7-4246-a6b4-279a1140325d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:02.049056 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-6834cc24-e1d7-4246-a6b4-279a1140325d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629/ips" status: 200 len: 151 microversion: 2.1 time: 0.046619 Sep 01 16:40:02.050160 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 250/531] 10.222.0.62 () {58 vars in 1248 bytes} [Thu Sep 1 16:40:02 2022] GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629/ips => generated 151 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:40:02.061089 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-46de1cc1-3a6f-40f1-87d9-003196e4bb3f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "38e7f701-4a58-42b3-97e2-e6f8a921b80e"}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:02.063548 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-46de1cc1-3a6f-40f1-87d9-003196e4bb3f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: c22c916b-390e-4bfe-8529-695bac5e5629] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:02.070317 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-46de1cc1-3a6f-40f1-87d9-003196e4bb3f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:02.071018 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-46de1cc1-3a6f-40f1-87d9-003196e4bb3f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:02.071454 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-46de1cc1-3a6f-40f1-87d9-003196e4bb3f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:02.072251 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-46de1cc1-3a6f-40f1-87d9-003196e4bb3f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:02.072761 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-46de1cc1-3a6f-40f1-87d9-003196e4bb3f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:02.073492 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-46de1cc1-3a6f-40f1-87d9-003196e4bb3f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:02.181767 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-46de1cc1-3a6f-40f1-87d9-003196e4bb3f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] HTTP exception thrown: Invalid volume: volume 38e7f701-4a58-42b3-97e2-e6f8a921b80e is already attached to instances: b16ceffd-c9b2-49e6-a44d-7353a17f230a Sep 01 16:40:02.183839 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-46de1cc1-3a6f-40f1-87d9-003196e4bb3f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Request method failure captured: Sep 01 16:40:02.183839 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: request: POST /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629/os-volume_attachments HTTP/1.1 Sep 01 16:40:02.183839 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 01 16:40:02.183839 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 01 16:40:02.183839 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Connection: close Sep 01 16:40:02.183839 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Length: 74 Sep 01 16:40:02.183839 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 01 16:40:02.183839 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Host: 10.222.0.62 Sep 01 16:40:02.183839 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 01 16:40:02.183839 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 01 16:40:02.183839 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjEN-Kf91-eSEr2HhmjJIIgtYULBlBY-_2maPsbMdhNYFHSV_2GN_ZKS8U6xUKw2g04Iz3Qw_Xw-tS9eWLaTCLiW-EojfuMRS-R2za92DHQcsAGlHP3o3mR6IH5zGmVt2sA1DmWsxd2yJWFWJwD0x6dDi28dXP3yLWa_ynp6SafwxV-ns Sep 01 16:40:02.183839 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 01 16:40:02.183839 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 01 16:40:02.183839 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 01 16:40:02.183839 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 01 16:40:02.183839 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 01 16:40:02.183839 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 01 16:40:02.183839 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Id: c6eb3ba21eae45898f42f3456591591e Sep 01 16:40:02.183839 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-AttachVolumeNegativeTest-1769141885 Sep 01 16:40:02.183839 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 01 16:40:02.183839 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 01 16:40:02.185638 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c6eb3ba21eae45898f42f3456591591e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c6eb3ba21eae45898f42f3456591591e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c6eb3ba21eae45898f42f3456591591e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c6eb3ba21eae45898f42f3456591591e"}]}] Sep 01 16:40:02.185638 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-AttachVolumeNegativeTest-1769141885 Sep 01 16:40:02.185638 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Id: c6eb3ba21eae45898f42f3456591591e Sep 01 16:40:02.185638 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1769141885 Sep 01 16:40:02.185638 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User: tempest-AttachVolumeNegativeTest-1769141885-project Sep 01 16:40:02.185638 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 01 16:40:02.185638 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 01 16:40:02.185638 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Id: 3a9b222396b1438f9fa0af0e197a9293 Sep 01 16:40:02.185638 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-AttachVolumeNegativeTest-1769141885-project Sep 01 16:40:02.185638 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Sep 01 16:40:02.185638 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: {"volumeAttachment": {"volumeId": "38e7f701-4a58-42b3-97e2-e6f8a921b80e"}} Sep 01 16:40:02.185638 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: method: > Sep 01 16:40:02.188574 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: exception: Invalid volume: volume 38e7f701-4a58-42b3-97e2-e6f8a921b80e is already attached to instances: b16ceffd-c9b2-49e6-a44d-7353a17f230a Sep 01 16:40:02.188574 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: action_args: {'server_id': 'c22c916b-390e-4bfe-8529-695bac5e5629', 'body': {'volumeAttachment': {'volumeId': '38e7f701-4a58-42b3-97e2-e6f8a921b80e'}}} Sep 01 16:40:02.188574 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:40:02.188574 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:02.188574 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 16:40:02.188574 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 16:40:02.188574 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 16:40:02.188574 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 16:40:02.188574 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 16:40:02.188574 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 16:40:02.188574 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 01 16:40:02.188574 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 01 16:40:02.188574 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 01 16:40:02.188574 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 01 16:40:02.188574 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 38e7f701-4a58-42b3-97e2-e6f8a921b80e is already attached to instances: b16ceffd-c9b2-49e6-a44d-7353a17f230a Sep 01 16:40:02.188574 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:40:02.188574 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:40:02.188574 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:40:02.188574 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:02.190016 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:40:02.190016 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:40:02.190016 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:40:02.190016 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:40:02.190016 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:40:02.190016 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:40:02.190016 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 16:40:02.190016 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 16:40:02.190016 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 16:40:02.190016 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 16:40:02.190016 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 16:40:02.190016 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 16:40:02.190016 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 01 16:40:02.190016 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 16:40:02.190016 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 38e7f701-4a58-42b3-97e2-e6f8a921b80e is already attached to instances: b16ceffd-c9b2-49e6-a44d-7353a17f230a Sep 01 16:40:02.190016 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:40:02.190016 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:40:02.190016 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:40:02.190016 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:02.190016 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:40:02.191905 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:40:02.191905 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:40:02.191905 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:40:02.191905 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 38e7f701-4a58-42b3-97e2-e6f8a921b80e is already attached to instances: b16ceffd-c9b2-49e6-a44d-7353a17f230a Sep 01 16:40:02.191905 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:40:02.191905 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-46de1cc1-3a6f-40f1-87d9-003196e4bb3f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Returning 400 to user: Invalid volume: volume 38e7f701-4a58-42b3-97e2-e6f8a921b80e is already attached to instances: b16ceffd-c9b2-49e6-a44d-7353a17f230a {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:40:02.191905 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-46de1cc1-3a6f-40f1-87d9-003196e4bb3f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "POST /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.128510 Sep 01 16:40:02.191905 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 282/532] 10.222.0.62 () {60 vars in 1323 bytes} [Thu Sep 1 16:40:02 2022] POST /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629/os-volume_attachments => generated 174 bytes in 130 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 16:40:02.196098 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-94947edc-391a-4d28-a4b4-ab5ac8902cae tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:02.196604 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-94947edc-391a-4d28-a4b4-ab5ac8902cae tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: c22c916b-390e-4bfe-8529-695bac5e5629] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:02.204816 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-94947edc-391a-4d28-a4b4-ab5ac8902cae tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:02.205234 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-94947edc-391a-4d28-a4b4-ab5ac8902cae tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:02.205992 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-94947edc-391a-4d28-a4b4-ab5ac8902cae tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:02.206682 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-94947edc-391a-4d28-a4b4-ab5ac8902cae tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:02.207378 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-94947edc-391a-4d28-a4b4-ab5ac8902cae tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:02.208011 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-94947edc-391a-4d28-a4b4-ab5ac8902cae tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:02.236277 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-94947edc-391a-4d28-a4b4-ab5ac8902cae tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: c22c916b-390e-4bfe-8529-695bac5e5629] Going to try to terminate instance {{(pid=127198) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:40:02.347815 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-94947edc-391a-4d28-a4b4-ab5ac8902cae tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629" status: 204 len: 0 microversion: 2.1 time: 0.155270 Sep 01 16:40:02.348672 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 251/533] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Sep 1 16:40:02 2022] DELETE /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:40:02.360296 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-1302fc5b-1536-4a1c-9e0b-37133bfb1146 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:02.361526 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-1302fc5b-1536-4a1c-9e0b-37133bfb1146 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: c22c916b-390e-4bfe-8529-695bac5e5629] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:02.375201 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1302fc5b-1536-4a1c-9e0b-37133bfb1146 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:02.376648 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1302fc5b-1536-4a1c-9e0b-37133bfb1146 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:02.378531 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1302fc5b-1536-4a1c-9e0b-37133bfb1146 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:02.380158 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1302fc5b-1536-4a1c-9e0b-37133bfb1146 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:02.380978 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1302fc5b-1536-4a1c-9e0b-37133bfb1146 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:02.381552 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1302fc5b-1536-4a1c-9e0b-37133bfb1146 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:02.587048 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-1302fc5b-1536-4a1c-9e0b-37133bfb1146 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:02.598990 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-1302fc5b-1536-4a1c-9e0b-37133bfb1146 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629" status: 200 len: 1683 microversion: 2.1 time: 0.245333 Sep 01 16:40:02.599953 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 283/534] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:02 2022] GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629 => generated 1683 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:02.611350 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-264d2833-588a-4539-a9e9-69595536f9bd tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:02.612406 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-264d2833-588a-4539-a9e9-69595536f9bd tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:02.620061 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-264d2833-588a-4539-a9e9-69595536f9bd tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:02.620716 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-264d2833-588a-4539-a9e9-69595536f9bd tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:02.621423 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-264d2833-588a-4539-a9e9-69595536f9bd tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:02.622234 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-264d2833-588a-4539-a9e9-69595536f9bd tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:02.622921 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-264d2833-588a-4539-a9e9-69595536f9bd tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:02.623936 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-264d2833-588a-4539-a9e9-69595536f9bd tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:02.645129 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:02.830481 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-264d2833-588a-4539-a9e9-69595536f9bd tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:02.840748 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-264d2833-588a-4539-a9e9-69595536f9bd tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1676 microversion: 2.1 time: 0.233686 Sep 01 16:40:02.842000 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 252/535] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:02 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1676 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:03.632634 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ff9dd6a7-9644-4cff-b6e4-e79a43b61631 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:03.634648 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ff9dd6a7-9644-4cff-b6e4-e79a43b61631 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: c22c916b-390e-4bfe-8529-695bac5e5629] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:03.647200 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ff9dd6a7-9644-4cff-b6e4-e79a43b61631 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:03.648609 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ff9dd6a7-9644-4cff-b6e4-e79a43b61631 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:03.649667 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ff9dd6a7-9644-4cff-b6e4-e79a43b61631 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:03.651054 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ff9dd6a7-9644-4cff-b6e4-e79a43b61631 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:03.652187 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ff9dd6a7-9644-4cff-b6e4-e79a43b61631 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:03.653211 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ff9dd6a7-9644-4cff-b6e4-e79a43b61631 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:03.873750 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-595be0e4-ea2c-4286-8af2-dc9e312a4dc0 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:03.875651 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-595be0e4-ea2c-4286-8af2-dc9e312a4dc0 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:03.898670 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-595be0e4-ea2c-4286-8af2-dc9e312a4dc0 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:03.901180 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-595be0e4-ea2c-4286-8af2-dc9e312a4dc0 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:03.901919 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ff9dd6a7-9644-4cff-b6e4-e79a43b61631 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:03.902884 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-595be0e4-ea2c-4286-8af2-dc9e312a4dc0 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:03.904147 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-595be0e4-ea2c-4286-8af2-dc9e312a4dc0 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:03.905390 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-595be0e4-ea2c-4286-8af2-dc9e312a4dc0 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:03.906765 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-595be0e4-ea2c-4286-8af2-dc9e312a4dc0 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:03.920152 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ff9dd6a7-9644-4cff-b6e4-e79a43b61631 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629" status: 200 len: 1683 microversion: 2.1 time: 0.299796 Sep 01 16:40:03.922553 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 284/536] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:03 2022] GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629 => generated 1683 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:04.125692 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-595be0e4-ea2c-4286-8af2-dc9e312a4dc0 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:04.135691 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-595be0e4-ea2c-4286-8af2-dc9e312a4dc0 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1676 microversion: 2.1 time: 0.270091 Sep 01 16:40:04.136569 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 253/537] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:03 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1676 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:04.958917 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c3a963ca-0b45-471a-acbe-d2b88d0b7316 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:04.959578 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-c3a963ca-0b45-471a-acbe-d2b88d0b7316 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: c22c916b-390e-4bfe-8529-695bac5e5629] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:04.966586 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c3a963ca-0b45-471a-acbe-d2b88d0b7316 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:04.967459 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c3a963ca-0b45-471a-acbe-d2b88d0b7316 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:04.968250 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c3a963ca-0b45-471a-acbe-d2b88d0b7316 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:04.977101 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c3a963ca-0b45-471a-acbe-d2b88d0b7316 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:04.978325 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c3a963ca-0b45-471a-acbe-d2b88d0b7316 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:04.979096 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c3a963ca-0b45-471a-acbe-d2b88d0b7316 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:05.168888 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a6713a62-abc8-41cf-ae3a-2173fdcc6beb tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:05.170736 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a6713a62-abc8-41cf-ae3a-2173fdcc6beb tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:05.171812 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c3a963ca-0b45-471a-acbe-d2b88d0b7316 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:05.179123 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a6713a62-abc8-41cf-ae3a-2173fdcc6beb tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:05.179827 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a6713a62-abc8-41cf-ae3a-2173fdcc6beb tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:05.180475 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a6713a62-abc8-41cf-ae3a-2173fdcc6beb tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:05.181397 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a6713a62-abc8-41cf-ae3a-2173fdcc6beb tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:05.182037 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a6713a62-abc8-41cf-ae3a-2173fdcc6beb tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:05.182626 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a6713a62-abc8-41cf-ae3a-2173fdcc6beb tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:05.185526 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-c3a963ca-0b45-471a-acbe-d2b88d0b7316 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629" status: 200 len: 1683 microversion: 2.1 time: 0.229036 Sep 01 16:40:05.200760 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 285/538] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:04 2022] GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629 => generated 1683 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:05.485335 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a6713a62-abc8-41cf-ae3a-2173fdcc6beb tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:05.496249 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a6713a62-abc8-41cf-ae3a-2173fdcc6beb tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1676 microversion: 2.1 time: 0.332918 Sep 01 16:40:05.496829 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 254/539] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:05 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1676 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:40:05.730592 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-7adc8fcd-2e6d-4e81-a475-f1ee5bda8477 req-0e0ab5a2-e7a4-44c7-8674-1ac4e3655d8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c22c916b-390e-4bfe-8529-695bac5e5629", "name": "network-vif-deleted", "tag": "80b3e074-a837-4fc6-943a-2a3be4791735"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:05.760175 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-7adc8fcd-2e6d-4e81-a475-f1ee5bda8477 req-0e0ab5a2-e7a4-44c7-8674-1ac4e3655d8c service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:05.760683 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-7adc8fcd-2e6d-4e81-a475-f1ee5bda8477 req-0e0ab5a2-e7a4-44c7-8674-1ac4e3655d8c service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:05.763306 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-7adc8fcd-2e6d-4e81-a475-f1ee5bda8477 req-0e0ab5a2-e7a4-44c7-8674-1ac4e3655d8c service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:05.798459 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-7adc8fcd-2e6d-4e81-a475-f1ee5bda8477 req-0e0ab5a2-e7a4-44c7-8674-1ac4e3655d8c service nova] Creating event network-vif-deleted:80b3e074-a837-4fc6-943a-2a3be4791735 for instance c22c916b-390e-4bfe-8529-695bac5e5629 on hv-cinder-85221 Sep 01 16:40:05.818171 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-7adc8fcd-2e6d-4e81-a475-f1ee5bda8477 req-0e0ab5a2-e7a4-44c7-8674-1ac4e3655d8c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090266 Sep 01 16:40:05.823608 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 286/540] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:40:06.208996 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-85cf7c10-70bf-4e63-b6d4-08109139f853 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:06.217567 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-85cf7c10-70bf-4e63-b6d4-08109139f853 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: c22c916b-390e-4bfe-8529-695bac5e5629] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:06.234155 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-85cf7c10-70bf-4e63-b6d4-08109139f853 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:06.234654 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-85cf7c10-70bf-4e63-b6d4-08109139f853 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:06.235287 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-85cf7c10-70bf-4e63-b6d4-08109139f853 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:06.236027 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-85cf7c10-70bf-4e63-b6d4-08109139f853 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:06.240109 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-85cf7c10-70bf-4e63-b6d4-08109139f853 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:06.241279 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-85cf7c10-70bf-4e63-b6d4-08109139f853 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:06.292117 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-85cf7c10-70bf-4e63-b6d4-08109139f853 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:06.292806 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-85cf7c10-70bf-4e63-b6d4-08109139f853 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:06.293401 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-85cf7c10-70bf-4e63-b6d4-08109139f853 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:06.294110 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-85cf7c10-70bf-4e63-b6d4-08109139f853 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lazy-loading 'fault' on Instance uuid c22c916b-390e-4bfe-8529-695bac5e5629 {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:40:06.370121 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-85cf7c10-70bf-4e63-b6d4-08109139f853 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:06.391834 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-85cf7c10-70bf-4e63-b6d4-08109139f853 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629" status: 200 len: 1331 microversion: 2.1 time: 0.187091 Sep 01 16:40:06.392391 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 255/541] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:06 2022] GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629 => generated 1331 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:06.520966 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-45c333ee-dadb-405f-8fec-c5c49f82acdc tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:06.522485 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-45c333ee-dadb-405f-8fec-c5c49f82acdc tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:06.549240 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-45c333ee-dadb-405f-8fec-c5c49f82acdc tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:06.549911 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-45c333ee-dadb-405f-8fec-c5c49f82acdc tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:06.551329 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-45c333ee-dadb-405f-8fec-c5c49f82acdc tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:06.552156 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-45c333ee-dadb-405f-8fec-c5c49f82acdc tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:06.552643 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-45c333ee-dadb-405f-8fec-c5c49f82acdc tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:06.553049 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-45c333ee-dadb-405f-8fec-c5c49f82acdc tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:06.830426 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-45c333ee-dadb-405f-8fec-c5c49f82acdc tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:06.842837 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-45c333ee-dadb-405f-8fec-c5c49f82acdc tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1676 microversion: 2.1 time: 0.327492 Sep 01 16:40:06.857245 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 287/542] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:06 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1676 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:07.414791 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a681c310-9e0e-4dc3-bbbe-c2d5c430b45c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:07.417098 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a681c310-9e0e-4dc3-bbbe-c2d5c430b45c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: c22c916b-390e-4bfe-8529-695bac5e5629] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:07.431448 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a681c310-9e0e-4dc3-bbbe-c2d5c430b45c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:07.432194 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a681c310-9e0e-4dc3-bbbe-c2d5c430b45c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:07.432964 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a681c310-9e0e-4dc3-bbbe-c2d5c430b45c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:07.434193 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a681c310-9e0e-4dc3-bbbe-c2d5c430b45c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:07.434890 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a681c310-9e0e-4dc3-bbbe-c2d5c430b45c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:07.435539 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a681c310-9e0e-4dc3-bbbe-c2d5c430b45c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:07.463573 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-a681c310-9e0e-4dc3-bbbe-c2d5c430b45c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] HTTP exception thrown: Instance c22c916b-390e-4bfe-8529-695bac5e5629 could not be found. Sep 01 16:40:07.465975 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a681c310-9e0e-4dc3-bbbe-c2d5c430b45c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Request method failure captured: Sep 01 16:40:07.465975 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629 HTTP/1.1 Sep 01 16:40:07.465975 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 01 16:40:07.465975 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 01 16:40:07.465975 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Connection: close Sep 01 16:40:07.465975 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 01 16:40:07.465975 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 01 16:40:07.465975 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Host: 10.222.0.62 Sep 01 16:40:07.465975 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 01 16:40:07.465975 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 01 16:40:07.465975 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjEN-Kf91-eSEr2HhmjJIIgtYULBlBY-_2maPsbMdhNYFHSV_2GN_ZKS8U6xUKw2g04Iz3Qw_Xw-tS9eWLaTCLiW-EojfuMRS-R2za92DHQcsAGlHP3o3mR6IH5zGmVt2sA1DmWsxd2yJWFWJwD0x6dDi28dXP3yLWa_ynp6SafwxV-ns Sep 01 16:40:07.465975 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 01 16:40:07.465975 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 01 16:40:07.465975 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 01 16:40:07.465975 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 01 16:40:07.465975 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 01 16:40:07.465975 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 01 16:40:07.465975 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Id: c6eb3ba21eae45898f42f3456591591e Sep 01 16:40:07.465975 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-AttachVolumeNegativeTest-1769141885 Sep 01 16:40:07.465975 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 01 16:40:07.465975 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 01 16:40:07.467526 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c6eb3ba21eae45898f42f3456591591e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c6eb3ba21eae45898f42f3456591591e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c6eb3ba21eae45898f42f3456591591e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c6eb3ba21eae45898f42f3456591591e"}]}] Sep 01 16:40:07.467526 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-AttachVolumeNegativeTest-1769141885 Sep 01 16:40:07.467526 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Id: c6eb3ba21eae45898f42f3456591591e Sep 01 16:40:07.467526 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1769141885 Sep 01 16:40:07.467526 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User: tempest-AttachVolumeNegativeTest-1769141885-project Sep 01 16:40:07.467526 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 01 16:40:07.467526 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 01 16:40:07.467526 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Id: 3a9b222396b1438f9fa0af0e197a9293 Sep 01 16:40:07.467526 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-AttachVolumeNegativeTest-1769141885-project Sep 01 16:40:07.467526 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: method: > Sep 01 16:40:07.467526 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: exception: Instance c22c916b-390e-4bfe-8529-695bac5e5629 could not be found. Sep 01 16:40:07.467526 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: action_args: {'id': 'c22c916b-390e-4bfe-8529-695bac5e5629'} Sep 01 16:40:07.468658 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:40:07.468658 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:07.468658 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:40:07.468658 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:40:07.468658 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:40:07.468658 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:40:07.468658 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:40:07.468658 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:40:07.468658 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:40:07.468658 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:40:07.468658 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c22c916b-390e-4bfe-8529-695bac5e5629 could not be found. Sep 01 16:40:07.468658 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:40:07.468658 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:40:07.468658 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:40:07.468658 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:07.468658 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:40:07.468658 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:40:07.468658 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:40:07.468658 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:40:07.468658 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:40:07.470291 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:40:07.470291 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:40:07.470291 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:40:07.470291 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:40:07.470291 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:40:07.470291 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:40:07.470291 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:40:07.470291 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c22c916b-390e-4bfe-8529-695bac5e5629 could not be found. Sep 01 16:40:07.470291 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:40:07.470291 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:40:07.470291 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:40:07.470291 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:07.470291 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:40:07.470291 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:40:07.470291 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:40:07.470291 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:40:07.470291 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c22c916b-390e-4bfe-8529-695bac5e5629 could not be found. Sep 01 16:40:07.470291 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:40:07.472505 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a681c310-9e0e-4dc3-bbbe-c2d5c430b45c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Returning 404 to user: Instance c22c916b-390e-4bfe-8529-695bac5e5629 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:40:07.473616 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a681c310-9e0e-4dc3-bbbe-c2d5c430b45c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629" status: 404 len: 111 microversion: 2.1 time: 0.063145 Sep 01 16:40:07.474398 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 256/543] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:07 2022] GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:40:07.483145 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8a3903b8-9ef5-414a-a8ca-cbfeb4a3db0d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '.version_select at 0x7f9482433dc0>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:07.518180 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8a3903b8-9ef5-414a-a8ca-cbfeb4a3db0d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1179319767" status: 202 len: 0 microversion: 2.1 time: 0.038843 Sep 01 16:40:07.519592 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 288/544] 10.222.0.62 () {58 vars in 1221 bytes} [Thu Sep 1 16:40:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1179319767 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:40:07.868758 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d479aa84-7e17-4128-af75-d7481cfa50bb tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:07.869825 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d479aa84-7e17-4128-af75-d7481cfa50bb tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:07.878344 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d479aa84-7e17-4128-af75-d7481cfa50bb tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:07.879231 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d479aa84-7e17-4128-af75-d7481cfa50bb tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:07.879676 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d479aa84-7e17-4128-af75-d7481cfa50bb tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:07.880392 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d479aa84-7e17-4128-af75-d7481cfa50bb tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:07.880869 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d479aa84-7e17-4128-af75-d7481cfa50bb tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:07.881320 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d479aa84-7e17-4128-af75-d7481cfa50bb tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:08.152639 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d479aa84-7e17-4128-af75-d7481cfa50bb tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:08.161319 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d479aa84-7e17-4128-af75-d7481cfa50bb tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1676 microversion: 2.1 time: 0.296642 Sep 01 16:40:08.164204 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 257/545] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:07 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1676 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:08.768203 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-3786e854-aa7a-4ddb-91a7-d1df0d631f5e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:08.770889 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-3786e854-aa7a-4ddb-91a7-d1df0d631f5e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:08.780759 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3786e854-aa7a-4ddb-91a7-d1df0d631f5e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:08.781251 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3786e854-aa7a-4ddb-91a7-d1df0d631f5e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:08.781679 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3786e854-aa7a-4ddb-91a7-d1df0d631f5e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:08.782521 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3786e854-aa7a-4ddb-91a7-d1df0d631f5e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:08.782923 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3786e854-aa7a-4ddb-91a7-d1df0d631f5e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:08.783347 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3786e854-aa7a-4ddb-91a7-d1df0d631f5e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:08.804862 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7c710e00-aa3e-436f-8afb-7c2f40752022 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:08.806572 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7c710e00-aa3e-436f-8afb-7c2f40752022 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: b16ceffd-c9b2-49e6-a44d-7353a17f230a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:08.815123 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.objects.instance [None req-3786e854-aa7a-4ddb-91a7-d1df0d631f5e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lazy-loading 'flavor' on Instance uuid f85533a0-bc5b-465a-895d-a473efbb0859 {{(pid=127199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:40:08.826488 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7c710e00-aa3e-436f-8afb-7c2f40752022 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:08.826962 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7c710e00-aa3e-436f-8afb-7c2f40752022 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:08.827697 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7c710e00-aa3e-436f-8afb-7c2f40752022 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:08.828817 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7c710e00-aa3e-436f-8afb-7c2f40752022 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:08.829473 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7c710e00-aa3e-436f-8afb-7c2f40752022 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:08.830040 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7c710e00-aa3e-436f-8afb-7c2f40752022 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:08.939879 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-7c710e00-aa3e-436f-8afb-7c2f40752022 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lazy-loading 'services' on Instance uuid b16ceffd-c9b2-49e6-a44d-7353a17f230a {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:40:08.981942 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-3786e854-aa7a-4ddb-91a7-d1df0d631f5e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "POST /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859/action" status: 200 len: 32 microversion: 2.1 time: 0.228769 Sep 01 16:40:08.983285 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 289/546] 10.222.0.62 () {60 vars in 1278 bytes} [Thu Sep 1 16:40:08 2022] POST /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859/action => generated 32 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 16:40:08.994913 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d4f73347-dd3a-471b-8094-fef0834b955e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:08.996194 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d4f73347-dd3a-471b-8094-fef0834b955e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:09.008058 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d4f73347-dd3a-471b-8094-fef0834b955e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:09.008642 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d4f73347-dd3a-471b-8094-fef0834b955e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:09.009152 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d4f73347-dd3a-471b-8094-fef0834b955e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:09.009982 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d4f73347-dd3a-471b-8094-fef0834b955e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:09.010372 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d4f73347-dd3a-471b-8094-fef0834b955e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:09.010790 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d4f73347-dd3a-471b-8094-fef0834b955e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:09.079548 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7c710e00-aa3e-436f-8afb-7c2f40752022 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "DELETE /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a/os-volume_attachments/38e7f701-4a58-42b3-97e2-e6f8a921b80e" status: 202 len: 0 microversion: 2.1 time: 0.278406 Sep 01 16:40:09.085127 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 258/547] 10.222.0.62 () {58 vars in 1416 bytes} [Thu Sep 1 16:40:08 2022] DELETE /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a/os-volume_attachments/38e7f701-4a58-42b3-97e2-e6f8a921b80e => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 16:40:09.098836 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1d95e9ba-cd78-4f37-b553-82e1d9471a56 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:09.106001 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1d95e9ba-cd78-4f37-b553-82e1d9471a56 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: b16ceffd-c9b2-49e6-a44d-7353a17f230a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:09.123259 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1d95e9ba-cd78-4f37-b553-82e1d9471a56 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:09.124634 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1d95e9ba-cd78-4f37-b553-82e1d9471a56 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:09.125303 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1d95e9ba-cd78-4f37-b553-82e1d9471a56 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:09.126036 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1d95e9ba-cd78-4f37-b553-82e1d9471a56 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:09.127186 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1d95e9ba-cd78-4f37-b553-82e1d9471a56 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:09.127773 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1d95e9ba-cd78-4f37-b553-82e1d9471a56 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:09.178944 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1d95e9ba-cd78-4f37-b553-82e1d9471a56 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092212 Sep 01 16:40:09.180051 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 259/548] 10.222.0.62 () {58 vars in 1302 bytes} [Thu Sep 1 16:40:09 2022] GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:40:09.190676 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f1e4c8c3-6e9e-4105-99f0-1495f211f698 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:09.191584 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f1e4c8c3-6e9e-4105-99f0-1495f211f698 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:09.201450 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f1e4c8c3-6e9e-4105-99f0-1495f211f698 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:09.202204 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f1e4c8c3-6e9e-4105-99f0-1495f211f698 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:09.202874 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f1e4c8c3-6e9e-4105-99f0-1495f211f698 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:09.203878 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f1e4c8c3-6e9e-4105-99f0-1495f211f698 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:09.204547 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f1e4c8c3-6e9e-4105-99f0-1495f211f698 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:09.205158 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f1e4c8c3-6e9e-4105-99f0-1495f211f698 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:09.331423 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d4f73347-dd3a-471b-8094-fef0834b955e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:09.343839 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d4f73347-dd3a-471b-8094-fef0834b955e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 200 len: 1736 microversion: 2.1 time: 0.353624 Sep 01 16:40:09.344386 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 290/549] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:08 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 1736 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:40:09.446878 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f1e4c8c3-6e9e-4105-99f0-1495f211f698 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:09.457729 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f1e4c8c3-6e9e-4105-99f0-1495f211f698 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1676 microversion: 2.1 time: 0.276117 Sep 01 16:40:09.458485 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 260/550] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:09 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1676 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:10.192826 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ce427d91-6c98-44d8-b9fa-b77e6f24c97d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:10.195409 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ce427d91-6c98-44d8-b9fa-b77e6f24c97d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: b16ceffd-c9b2-49e6-a44d-7353a17f230a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:10.202464 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ce427d91-6c98-44d8-b9fa-b77e6f24c97d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:10.203299 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ce427d91-6c98-44d8-b9fa-b77e6f24c97d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:10.204132 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ce427d91-6c98-44d8-b9fa-b77e6f24c97d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:10.205076 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ce427d91-6c98-44d8-b9fa-b77e6f24c97d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:10.205583 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ce427d91-6c98-44d8-b9fa-b77e6f24c97d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:10.206070 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ce427d91-6c98-44d8-b9fa-b77e6f24c97d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:10.239681 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ce427d91-6c98-44d8-b9fa-b77e6f24c97d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051477 Sep 01 16:40:10.241036 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 291/551] 10.222.0.62 () {58 vars in 1302 bytes} [Thu Sep 1 16:40:10 2022] GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 01 16:40:10.311342 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5677338a-713a-43ab-940b-3c5cf528242c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:10.312556 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5677338a-713a-43ab-940b-3c5cf528242c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: b16ceffd-c9b2-49e6-a44d-7353a17f230a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:10.319095 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5677338a-713a-43ab-940b-3c5cf528242c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:10.319579 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5677338a-713a-43ab-940b-3c5cf528242c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:10.320044 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5677338a-713a-43ab-940b-3c5cf528242c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:10.320742 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5677338a-713a-43ab-940b-3c5cf528242c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:10.321192 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5677338a-713a-43ab-940b-3c5cf528242c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:10.321801 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5677338a-713a-43ab-940b-3c5cf528242c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:10.350578 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5677338a-713a-43ab-940b-3c5cf528242c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: b16ceffd-c9b2-49e6-a44d-7353a17f230a] Going to try to terminate instance {{(pid=127198) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:40:10.364820 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-356e03af-2466-4f52-96ba-9a6253d4f7e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:10.365772 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-356e03af-2466-4f52-96ba-9a6253d4f7e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:10.372147 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-356e03af-2466-4f52-96ba-9a6253d4f7e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:10.372875 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-356e03af-2466-4f52-96ba-9a6253d4f7e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:10.373547 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-356e03af-2466-4f52-96ba-9a6253d4f7e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:10.374625 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-356e03af-2466-4f52-96ba-9a6253d4f7e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:10.375339 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-356e03af-2466-4f52-96ba-9a6253d4f7e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:10.376065 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-356e03af-2466-4f52-96ba-9a6253d4f7e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:10.440705 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:10.488805 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5677338a-713a-43ab-940b-3c5cf528242c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "DELETE /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a" status: 204 len: 0 microversion: 2.1 time: 0.182965 Sep 01 16:40:10.489941 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 261/552] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Sep 1 16:40:10 2022] DELETE /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:40:10.496222 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-116b1af7-dc46-41bc-86fe-9944c18f2986 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:10.497126 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-116b1af7-dc46-41bc-86fe-9944c18f2986 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:10.509309 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-116b1af7-dc46-41bc-86fe-9944c18f2986 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:10.510129 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-116b1af7-dc46-41bc-86fe-9944c18f2986 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:10.510845 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-116b1af7-dc46-41bc-86fe-9944c18f2986 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:10.514791 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-116b1af7-dc46-41bc-86fe-9944c18f2986 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:10.518728 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-116b1af7-dc46-41bc-86fe-9944c18f2986 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:10.520123 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-116b1af7-dc46-41bc-86fe-9944c18f2986 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:10.542281 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-356e03af-2466-4f52-96ba-9a6253d4f7e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:10.558891 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-356e03af-2466-4f52-96ba-9a6253d4f7e8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 200 len: 1736 microversion: 2.1 time: 0.197632 Sep 01 16:40:10.563942 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 292/553] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:10 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 1736 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:10.566130 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-37bdfbed-7319-48f2-ab87-223c848a07af tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:10.566819 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-37bdfbed-7319-48f2-ab87-223c848a07af tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: b16ceffd-c9b2-49e6-a44d-7353a17f230a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:10.574366 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-37bdfbed-7319-48f2-ab87-223c848a07af tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:10.575023 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-37bdfbed-7319-48f2-ab87-223c848a07af tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:10.575921 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-37bdfbed-7319-48f2-ab87-223c848a07af tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:10.576793 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-37bdfbed-7319-48f2-ab87-223c848a07af tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:10.577453 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-37bdfbed-7319-48f2-ab87-223c848a07af tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:10.578333 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-37bdfbed-7319-48f2-ab87-223c848a07af tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:10.791917 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-116b1af7-dc46-41bc-86fe-9944c18f2986 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:10.801832 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-116b1af7-dc46-41bc-86fe-9944c18f2986 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1676 microversion: 2.1 time: 0.310454 Sep 01 16:40:10.802534 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 262/554] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:10 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1676 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:10.821297 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-37bdfbed-7319-48f2-ab87-223c848a07af tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:10.831662 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-37bdfbed-7319-48f2-ab87-223c848a07af tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a" status: 200 len: 1681 microversion: 2.1 time: 0.270745 Sep 01 16:40:10.832303 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 293/555] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:10 2022] GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a => generated 1681 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:11.589426 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-93eb6971-9254-442f-91f9-6045f2bf812f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:11.590994 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-93eb6971-9254-442f-91f9-6045f2bf812f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:11.598768 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-93eb6971-9254-442f-91f9-6045f2bf812f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:11.599264 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-93eb6971-9254-442f-91f9-6045f2bf812f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:11.600007 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-93eb6971-9254-442f-91f9-6045f2bf812f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:11.600791 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-93eb6971-9254-442f-91f9-6045f2bf812f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:11.601470 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-93eb6971-9254-442f-91f9-6045f2bf812f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:11.602138 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-93eb6971-9254-442f-91f9-6045f2bf812f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:11.749448 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-93eb6971-9254-442f-91f9-6045f2bf812f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:11.760019 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-93eb6971-9254-442f-91f9-6045f2bf812f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 200 len: 1736 microversion: 2.1 time: 0.174388 Sep 01 16:40:11.760615 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 263/556] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:11 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:11.826878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-05ea2650-5b85-48e3-8f14-f449839c0cc2 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:11.827665 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-05ea2650-5b85-48e3-8f14-f449839c0cc2 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:11.833966 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-05ea2650-5b85-48e3-8f14-f449839c0cc2 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:11.834456 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-05ea2650-5b85-48e3-8f14-f449839c0cc2 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:11.835042 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-05ea2650-5b85-48e3-8f14-f449839c0cc2 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:11.835744 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-05ea2650-5b85-48e3-8f14-f449839c0cc2 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:11.836322 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-05ea2650-5b85-48e3-8f14-f449839c0cc2 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:11.836745 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-05ea2650-5b85-48e3-8f14-f449839c0cc2 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:11.862874 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-77e72ce8-ef9a-45c6-9187-fbf884a15605 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:11.863405 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-77e72ce8-ef9a-45c6-9187-fbf884a15605 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: b16ceffd-c9b2-49e6-a44d-7353a17f230a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:11.869939 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-77e72ce8-ef9a-45c6-9187-fbf884a15605 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:11.870463 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-77e72ce8-ef9a-45c6-9187-fbf884a15605 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:11.870873 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-77e72ce8-ef9a-45c6-9187-fbf884a15605 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:11.871581 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-77e72ce8-ef9a-45c6-9187-fbf884a15605 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:11.872073 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-77e72ce8-ef9a-45c6-9187-fbf884a15605 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:11.872498 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-77e72ce8-ef9a-45c6-9187-fbf884a15605 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:12.072022 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-05ea2650-5b85-48e3-8f14-f449839c0cc2 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:12.074975 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:12.087149 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-77e72ce8-ef9a-45c6-9187-fbf884a15605 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:12.104036 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-05ea2650-5b85-48e3-8f14-f449839c0cc2 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1676 microversion: 2.1 time: 0.275645 Sep 01 16:40:12.119213 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 294/557] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:11 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1676 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:12.119914 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-77e72ce8-ef9a-45c6-9187-fbf884a15605 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a" status: 200 len: 1681 microversion: 2.1 time: 0.250167 Sep 01 16:40:12.119914 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 264/558] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:11 2022] GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a => generated 1681 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:12.783839 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-93a5dc2a-c535-428b-8db7-dfab70601bb0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:12.784460 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-93a5dc2a-c535-428b-8db7-dfab70601bb0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:12.797695 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-93a5dc2a-c535-428b-8db7-dfab70601bb0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:12.801584 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-93a5dc2a-c535-428b-8db7-dfab70601bb0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:12.802249 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-93a5dc2a-c535-428b-8db7-dfab70601bb0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:12.803509 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-93a5dc2a-c535-428b-8db7-dfab70601bb0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:12.804225 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-93a5dc2a-c535-428b-8db7-dfab70601bb0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:12.804847 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-93a5dc2a-c535-428b-8db7-dfab70601bb0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:13.131612 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5f0f1d8c-c319-41d1-8f26-2ef801a0ce61 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:13.133010 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5f0f1d8c-c319-41d1-8f26-2ef801a0ce61 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:13.142109 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5f0f1d8c-c319-41d1-8f26-2ef801a0ce61 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:13.143045 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5f0f1d8c-c319-41d1-8f26-2ef801a0ce61 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:13.143689 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5f0f1d8c-c319-41d1-8f26-2ef801a0ce61 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:13.144608 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5f0f1d8c-c319-41d1-8f26-2ef801a0ce61 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:13.145225 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5f0f1d8c-c319-41d1-8f26-2ef801a0ce61 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:13.145848 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5f0f1d8c-c319-41d1-8f26-2ef801a0ce61 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:13.409629 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-93a5dc2a-c535-428b-8db7-dfab70601bb0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:13.421132 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-93a5dc2a-c535-428b-8db7-dfab70601bb0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 200 len: 1736 microversion: 2.1 time: 0.642046 Sep 01 16:40:13.422556 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 295/559] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:12 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 1736 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:13.429562 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-6b0907c1-1a5c-4be7-9176-a701cc5d91bb tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:13.430358 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-6b0907c1-1a5c-4be7-9176-a701cc5d91bb tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: b16ceffd-c9b2-49e6-a44d-7353a17f230a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:13.440824 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6b0907c1-1a5c-4be7-9176-a701cc5d91bb tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:13.441701 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6b0907c1-1a5c-4be7-9176-a701cc5d91bb tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:13.442285 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6b0907c1-1a5c-4be7-9176-a701cc5d91bb tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:13.443154 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6b0907c1-1a5c-4be7-9176-a701cc5d91bb tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:13.443933 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6b0907c1-1a5c-4be7-9176-a701cc5d91bb tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:13.444509 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6b0907c1-1a5c-4be7-9176-a701cc5d91bb tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:13.526487 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5f0f1d8c-c319-41d1-8f26-2ef801a0ce61 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:13.536796 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5f0f1d8c-c319-41d1-8f26-2ef801a0ce61 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1653 microversion: 2.1 time: 0.413065 Sep 01 16:40:13.560823 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 265/560] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:13 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1653 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:13.567746 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-83719b7c-b893-4fde-a12d-6293d4be8765 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:13.570129 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-6b0907c1-1a5c-4be7-9176-a701cc5d91bb tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:13.587085 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-6b0907c1-1a5c-4be7-9176-a701cc5d91bb tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a" status: 200 len: 1613 microversion: 2.1 time: 0.163032 Sep 01 16:40:13.590416 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 296/561] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:13 2022] GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a => generated 1613 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:13.592131 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-83719b7c-b893-4fde-a12d-6293d4be8765 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:13.596033 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-83719b7c-b893-4fde-a12d-6293d4be8765 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:13.597587 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-83719b7c-b893-4fde-a12d-6293d4be8765 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:13.653522 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-83719b7c-b893-4fde-a12d-6293d4be8765 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Going to try to start instance {{(pid=127198) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 01 16:40:13.685677 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:13.718403 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-83719b7c-b893-4fde-a12d-6293d4be8765 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "POST /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037/action" status: 202 len: 0 microversion: 2.1 time: 0.154844 Sep 01 16:40:13.723635 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 266/562] 10.222.0.62 () {60 vars in 1278 bytes} [Thu Sep 1 16:40:13 2022] POST /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:40:13.728451 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0873de03-8524-4e5d-a375-e95843437c09 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:13.729054 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-0873de03-8524-4e5d-a375-e95843437c09 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:13.741667 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0873de03-8524-4e5d-a375-e95843437c09 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:13.742437 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0873de03-8524-4e5d-a375-e95843437c09 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:13.743026 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0873de03-8524-4e5d-a375-e95843437c09 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:13.745138 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0873de03-8524-4e5d-a375-e95843437c09 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:13.747136 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0873de03-8524-4e5d-a375-e95843437c09 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:13.747790 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0873de03-8524-4e5d-a375-e95843437c09 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:13.985078 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-1afe073e-43d0-4bd2-8825-ef54439498b6 req-34d12668-7465-43e3-821d-4372263cc33a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b16ceffd-c9b2-49e6-a44d-7353a17f230a", "name": "network-vif-deleted", "tag": "b4253844-4c55-43ea-a36b-20d7a499e811"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:14.004958 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-1afe073e-43d0-4bd2-8825-ef54439498b6 req-34d12668-7465-43e3-821d-4372263cc33a service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:14.007577 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-1afe073e-43d0-4bd2-8825-ef54439498b6 req-34d12668-7465-43e3-821d-4372263cc33a service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:14.008342 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-1afe073e-43d0-4bd2-8825-ef54439498b6 req-34d12668-7465-43e3-821d-4372263cc33a service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:14.026499 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-1afe073e-43d0-4bd2-8825-ef54439498b6 req-34d12668-7465-43e3-821d-4372263cc33a service nova] Creating event network-vif-deleted:b4253844-4c55-43ea-a36b-20d7a499e811 for instance b16ceffd-c9b2-49e6-a44d-7353a17f230a on hv-cinder-85221 Sep 01 16:40:14.033389 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-1afe073e-43d0-4bd2-8825-ef54439498b6 req-34d12668-7465-43e3-821d-4372263cc33a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052761 Sep 01 16:40:14.047053 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 267/563] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:40:14.185161 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-0873de03-8524-4e5d-a375-e95843437c09 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:14.199040 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-0873de03-8524-4e5d-a375-e95843437c09 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1662 microversion: 2.1 time: 0.474411 Sep 01 16:40:14.199858 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 297/564] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:13 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1662 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:40:14.453611 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f478078b-8f68-4493-a4bc-0aba2a851dd5 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:14.455067 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f478078b-8f68-4493-a4bc-0aba2a851dd5 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:14.481560 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f478078b-8f68-4493-a4bc-0aba2a851dd5 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:14.483688 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f478078b-8f68-4493-a4bc-0aba2a851dd5 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:14.484604 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f478078b-8f68-4493-a4bc-0aba2a851dd5 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:14.489514 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f478078b-8f68-4493-a4bc-0aba2a851dd5 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:14.490146 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f478078b-8f68-4493-a4bc-0aba2a851dd5 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:14.490744 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f478078b-8f68-4493-a4bc-0aba2a851dd5 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:14.611604 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ee468892-57df-429d-9b49-51c62ac7fbaa tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:14.613265 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ee468892-57df-429d-9b49-51c62ac7fbaa tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: b16ceffd-c9b2-49e6-a44d-7353a17f230a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:14.627355 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ee468892-57df-429d-9b49-51c62ac7fbaa tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:14.628061 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ee468892-57df-429d-9b49-51c62ac7fbaa tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:14.628668 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ee468892-57df-429d-9b49-51c62ac7fbaa tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:14.629537 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ee468892-57df-429d-9b49-51c62ac7fbaa tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:14.630137 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ee468892-57df-429d-9b49-51c62ac7fbaa tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:14.630820 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ee468892-57df-429d-9b49-51c62ac7fbaa tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:14.691420 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ee468892-57df-429d-9b49-51c62ac7fbaa tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:14.692356 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ee468892-57df-429d-9b49-51c62ac7fbaa tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:14.692942 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ee468892-57df-429d-9b49-51c62ac7fbaa tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:14.693309 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f478078b-8f68-4493-a4bc-0aba2a851dd5 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:14.693727 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.objects.instance [None req-ee468892-57df-429d-9b49-51c62ac7fbaa tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lazy-loading 'fault' on Instance uuid b16ceffd-c9b2-49e6-a44d-7353a17f230a {{(pid=127199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:40:14.702045 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f478078b-8f68-4493-a4bc-0aba2a851dd5 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 200 len: 1736 microversion: 2.1 time: 0.262763 Sep 01 16:40:14.702656 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 268/565] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:14 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 1736 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:14.783383 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ee468892-57df-429d-9b49-51c62ac7fbaa tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:14.797789 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ee468892-57df-429d-9b49-51c62ac7fbaa tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a" status: 200 len: 1330 microversion: 2.1 time: 0.192539 Sep 01 16:40:14.798578 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 298/566] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:14 2022] GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a => generated 1330 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:40:15.227688 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-66ff27d0-1004-4727-8513-cfd33375b3aa tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:15.228481 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-66ff27d0-1004-4727-8513-cfd33375b3aa tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:15.245865 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-66ff27d0-1004-4727-8513-cfd33375b3aa tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:15.246444 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-66ff27d0-1004-4727-8513-cfd33375b3aa tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:15.247662 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-66ff27d0-1004-4727-8513-cfd33375b3aa tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:15.248510 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-66ff27d0-1004-4727-8513-cfd33375b3aa tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:15.249194 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-66ff27d0-1004-4727-8513-cfd33375b3aa tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:15.249744 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-66ff27d0-1004-4727-8513-cfd33375b3aa tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:15.464784 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-66ff27d0-1004-4727-8513-cfd33375b3aa tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:15.478981 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-66ff27d0-1004-4727-8513-cfd33375b3aa tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1662 microversion: 2.1 time: 0.255952 Sep 01 16:40:15.497357 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 269/567] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:15 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1662 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:40:15.734113 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d7fa8017-588d-4b74-a621-35fc908f0a5c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:15.735643 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d7fa8017-588d-4b74-a621-35fc908f0a5c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:15.742490 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d7fa8017-588d-4b74-a621-35fc908f0a5c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:15.769365 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d7fa8017-588d-4b74-a621-35fc908f0a5c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:15.769365 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d7fa8017-588d-4b74-a621-35fc908f0a5c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:15.769365 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d7fa8017-588d-4b74-a621-35fc908f0a5c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:15.769890 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d7fa8017-588d-4b74-a621-35fc908f0a5c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:15.770156 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d7fa8017-588d-4b74-a621-35fc908f0a5c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:15.819243 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-023aa332-64b3-4161-9901-b3416d2f922f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:15.820165 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-023aa332-64b3-4161-9901-b3416d2f922f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: b16ceffd-c9b2-49e6-a44d-7353a17f230a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:15.833980 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-023aa332-64b3-4161-9901-b3416d2f922f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:15.834300 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-023aa332-64b3-4161-9901-b3416d2f922f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:15.834750 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-023aa332-64b3-4161-9901-b3416d2f922f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:15.835465 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-023aa332-64b3-4161-9901-b3416d2f922f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:15.835959 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-023aa332-64b3-4161-9901-b3416d2f922f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:15.836393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-023aa332-64b3-4161-9901-b3416d2f922f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:15.853776 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-023aa332-64b3-4161-9901-b3416d2f922f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] HTTP exception thrown: Instance b16ceffd-c9b2-49e6-a44d-7353a17f230a could not be found. Sep 01 16:40:15.855779 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-023aa332-64b3-4161-9901-b3416d2f922f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Request method failure captured: Sep 01 16:40:15.855779 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a HTTP/1.1 Sep 01 16:40:15.855779 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 01 16:40:15.855779 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 01 16:40:15.855779 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Connection: close Sep 01 16:40:15.855779 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 01 16:40:15.855779 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 01 16:40:15.855779 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Host: 10.222.0.62 Sep 01 16:40:15.855779 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 01 16:40:15.855779 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 01 16:40:15.855779 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjEN-Kf91-eSEr2HhmjJIIgtYULBlBY-_2maPsbMdhNYFHSV_2GN_ZKS8U6xUKw2g04Iz3Qw_Xw-tS9eWLaTCLiW-EojfuMRS-R2za92DHQcsAGlHP3o3mR6IH5zGmVt2sA1DmWsxd2yJWFWJwD0x6dDi28dXP3yLWa_ynp6SafwxV-ns Sep 01 16:40:15.855779 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 01 16:40:15.855779 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 01 16:40:15.855779 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 01 16:40:15.855779 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 01 16:40:15.855779 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 01 16:40:15.855779 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 01 16:40:15.855779 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Id: c6eb3ba21eae45898f42f3456591591e Sep 01 16:40:15.855779 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-AttachVolumeNegativeTest-1769141885 Sep 01 16:40:15.855779 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 01 16:40:15.855779 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 01 16:40:15.857394 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c6eb3ba21eae45898f42f3456591591e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c6eb3ba21eae45898f42f3456591591e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c6eb3ba21eae45898f42f3456591591e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c6eb3ba21eae45898f42f3456591591e"}]}] Sep 01 16:40:15.857394 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-AttachVolumeNegativeTest-1769141885 Sep 01 16:40:15.857394 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Id: c6eb3ba21eae45898f42f3456591591e Sep 01 16:40:15.857394 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1769141885 Sep 01 16:40:15.857394 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User: tempest-AttachVolumeNegativeTest-1769141885-project Sep 01 16:40:15.857394 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 01 16:40:15.857394 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 01 16:40:15.857394 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Id: 3a9b222396b1438f9fa0af0e197a9293 Sep 01 16:40:15.857394 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-AttachVolumeNegativeTest-1769141885-project Sep 01 16:40:15.857394 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: method: > Sep 01 16:40:15.857394 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: exception: Instance b16ceffd-c9b2-49e6-a44d-7353a17f230a could not be found. Sep 01 16:40:15.857394 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: action_args: {'id': 'b16ceffd-c9b2-49e6-a44d-7353a17f230a'} Sep 01 16:40:15.858274 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:40:15.858274 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:15.858274 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:40:15.858274 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:40:15.858274 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:40:15.858274 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:40:15.858274 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:40:15.858274 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:40:15.858274 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:40:15.858274 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:40:15.858274 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b16ceffd-c9b2-49e6-a44d-7353a17f230a could not be found. Sep 01 16:40:15.858274 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:40:15.858274 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:40:15.858274 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:40:15.858274 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:15.858274 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:40:15.858274 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:40:15.858274 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:40:15.858274 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:40:15.858274 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:40:15.860213 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:40:15.860213 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:40:15.860213 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:40:15.860213 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:40:15.860213 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:40:15.860213 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:40:15.860213 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:40:15.860213 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b16ceffd-c9b2-49e6-a44d-7353a17f230a could not be found. Sep 01 16:40:15.860213 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:40:15.860213 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:40:15.860213 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:40:15.860213 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:15.860213 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:40:15.860213 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:40:15.860213 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:40:15.860213 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:40:15.860213 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b16ceffd-c9b2-49e6-a44d-7353a17f230a could not be found. Sep 01 16:40:15.860213 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:40:15.862767 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-023aa332-64b3-4161-9901-b3416d2f922f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Returning 404 to user: Instance b16ceffd-c9b2-49e6-a44d-7353a17f230a could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:40:15.863839 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-023aa332-64b3-4161-9901-b3416d2f922f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a" status: 404 len: 111 microversion: 2.1 time: 0.048707 Sep 01 16:40:15.868480 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 270/568] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:15 2022] GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:40:15.874268 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-738fd5d5-548b-4d08-bdaf-c8979817358b tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '.version_select at 0x7f9482271f70>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:15.906932 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-738fd5d5-548b-4d08-bdaf-c8979817358b tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-720016507" status: 202 len: 0 microversion: 2.1 time: 0.036990 Sep 01 16:40:15.911672 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 271/569] 10.222.0.62 () {58 vars in 1218 bytes} [Thu Sep 1 16:40:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-720016507 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:40:16.004995 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d7fa8017-588d-4b74-a621-35fc908f0a5c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:16.018755 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d7fa8017-588d-4b74-a621-35fc908f0a5c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 200 len: 1736 microversion: 2.1 time: 0.296410 Sep 01 16:40:16.019606 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 299/570] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:15 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 1736 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:16.511251 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e83acf70-88c5-4250-9d66-62997e7fa731 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:16.512682 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e83acf70-88c5-4250-9d66-62997e7fa731 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:16.544146 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e83acf70-88c5-4250-9d66-62997e7fa731 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:16.545081 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e83acf70-88c5-4250-9d66-62997e7fa731 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:16.545813 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e83acf70-88c5-4250-9d66-62997e7fa731 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:16.548733 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e83acf70-88c5-4250-9d66-62997e7fa731 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:16.549780 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e83acf70-88c5-4250-9d66-62997e7fa731 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:16.550699 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e83acf70-88c5-4250-9d66-62997e7fa731 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:16.801706 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e83acf70-88c5-4250-9d66-62997e7fa731 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:16.832667 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e83acf70-88c5-4250-9d66-62997e7fa731 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1666 microversion: 2.1 time: 0.325964 Sep 01 16:40:16.833355 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 272/571] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:16 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1666 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:16.877412 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-1ce70d98-04ff-486c-a8e1-229b7f7e4c9b tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Action: 'create', calling method: .version_select at 0x7f9482679040>, body: {"keypair": {"name": "tempest-keypair-1263511324", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqUXjWAofI5rjOJNuIO6uayfdcBM/9l9mizNmVWpJHoTircVEeawOOM/XvuVz8OgpG2itTSIC5M3aLR8otRPf8lPY2O/9IARti6N2Dn81fC7A9nAi3LQb2VaKN7qMtB/w=="}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:16.901304 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-1ce70d98-04ff-486c-a8e1-229b7f7e4c9b tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Getting quotas for project c6eb3ba21eae45898f42f3456591591e. Resources: {'key_pairs'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:40:16.905791 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-1ce70d98-04ff-486c-a8e1-229b7f7e4c9b tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Getting quotas for user 3a9b222396b1438f9fa0af0e197a9293 and project c6eb3ba21eae45898f42f3456591591e. Resources: {'key_pairs'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:40:16.932447 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-1ce70d98-04ff-486c-a8e1-229b7f7e4c9b tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.058621 Sep 01 16:40:16.933433 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 300/572] 10.222.0.62 () {60 vars in 1159 bytes} [Thu Sep 1 16:40:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:40:17.048226 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d3509adc-1d0e-4e0e-9b0d-d053d40ae13a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:17.049241 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d3509adc-1d0e-4e0e-9b0d-d053d40ae13a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:17.058317 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d3509adc-1d0e-4e0e-9b0d-d053d40ae13a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:17.059416 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d3509adc-1d0e-4e0e-9b0d-d053d40ae13a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:17.059997 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d3509adc-1d0e-4e0e-9b0d-d053d40ae13a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:17.060857 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d3509adc-1d0e-4e0e-9b0d-d053d40ae13a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:17.061404 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d3509adc-1d0e-4e0e-9b0d-d053d40ae13a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:17.062151 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d3509adc-1d0e-4e0e-9b0d-d053d40ae13a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:17.250084 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d3509adc-1d0e-4e0e-9b0d-d053d40ae13a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:17.259161 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d3509adc-1d0e-4e0e-9b0d-d053d40ae13a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 200 len: 1736 microversion: 2.1 time: 0.215209 Sep 01 16:40:17.260953 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 273/573] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:17 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:40:18.288248 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8e0af2e8-6786-4a4f-bd10-ee44d8f48b04 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:18.289424 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-8e0af2e8-6786-4a4f-bd10-ee44d8f48b04 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:18.307015 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8e0af2e8-6786-4a4f-bd10-ee44d8f48b04 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:18.307662 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8e0af2e8-6786-4a4f-bd10-ee44d8f48b04 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:18.308327 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8e0af2e8-6786-4a4f-bd10-ee44d8f48b04 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:18.309166 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8e0af2e8-6786-4a4f-bd10-ee44d8f48b04 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:18.311044 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8e0af2e8-6786-4a4f-bd10-ee44d8f48b04 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:18.311792 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8e0af2e8-6786-4a4f-bd10-ee44d8f48b04 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:18.623252 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8e0af2e8-6786-4a4f-bd10-ee44d8f48b04 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:18.646183 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8e0af2e8-6786-4a4f-bd10-ee44d8f48b04 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 200 len: 1736 microversion: 2.1 time: 0.367816 Sep 01 16:40:18.650912 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 301/574] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:18 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 1736 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:18.788309 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-22dcae11-d102-410c-80fb-f75ac2465484 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1952981092", "imageRef": "49e5276c-002c-454f-8be8-76deb18b6b28", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3ad8e59d-1d82-4cdb-9afd-98e6a7c8e50a"}], "security_groups": [{"name": "tempest-securitygroup--972931006"}], "key_name": "tempest-keypair-1263511324", "user_data": "}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:18.904662 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.network.neutron [None req-22dcae11-d102-410c-80fb-f75ac2465484 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] validate_networks() for [('3ad8e59d-1d82-4cdb-9afd-98e6a7c8e50a', None, None, None, None, None)] {{(pid=127198) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:40:19.394387 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-22dcae11-d102-410c-80fb-f75ac2465484 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Flavor limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:40:19.394811 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-22dcae11-d102-410c-80fb-f75ac2465484 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Image limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:40:19.395335 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-22dcae11-d102-410c-80fb-f75ac2465484 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Flavor pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:40:19.396051 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-22dcae11-d102-410c-80fb-f75ac2465484 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Image pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:40:19.396460 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-22dcae11-d102-410c-80fb-f75ac2465484 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:40:19.406338 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-22dcae11-d102-410c-80fb-f75ac2465484 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:19.406899 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-22dcae11-d102-410c-80fb-f75ac2465484 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:19.407333 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-22dcae11-d102-410c-80fb-f75ac2465484 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:19.408088 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-22dcae11-d102-410c-80fb-f75ac2465484 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:19.408573 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-22dcae11-d102-410c-80fb-f75ac2465484 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:19.408997 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-22dcae11-d102-410c-80fb-f75ac2465484 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:19.427784 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-22dcae11-d102-410c-80fb-f75ac2465484 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Getting quotas for project c6eb3ba21eae45898f42f3456591591e. Resources: {'ram', 'cores', 'instances'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:40:19.432106 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-22dcae11-d102-410c-80fb-f75ac2465484 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Getting quotas for user 3a9b222396b1438f9fa0af0e197a9293 and project c6eb3ba21eae45898f42f3456591591e. Resources: {'ram', 'cores', 'instances'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:40:19.443952 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-22dcae11-d102-410c-80fb-f75ac2465484 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Going to run 1 instances... {{(pid=127198) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:40:19.446275 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-22dcae11-d102-410c-80fb-f75ac2465484 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: 8055f17c-aded-4b3d-99b4-6ad010bb0e77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='49e5276c-002c-454f-8be8-76deb18b6b28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:40:19.497142 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-22dcae11-d102-410c-80fb-f75ac2465484 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.713098 Sep 01 16:40:19.497950 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 274/575] 10.222.0.62 () {60 vars in 1147 bytes} [Thu Sep 1 16:40:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:40:19.509618 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-57504bf0-f5e8-46ed-a5d0-b5e4faf67ff0 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:19.510267 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-57504bf0-f5e8-46ed-a5d0-b5e4faf67ff0 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: 8055f17c-aded-4b3d-99b4-6ad010bb0e77] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:19.571291 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-57504bf0-f5e8-46ed-a5d0-b5e4faf67ff0 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:19.579834 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-57504bf0-f5e8-46ed-a5d0-b5e4faf67ff0 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77" status: 200 len: 1242 microversion: 2.1 time: 0.073535 Sep 01 16:40:19.579834 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 302/576] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:19 2022] GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77 => generated 1242 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:19.686862 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0ced2a73-c29d-4279-887c-acde5bac4381 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:19.688540 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0ced2a73-c29d-4279-887c-acde5bac4381 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:19.694919 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0ced2a73-c29d-4279-887c-acde5bac4381 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:19.695479 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0ced2a73-c29d-4279-887c-acde5bac4381 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:19.696006 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0ced2a73-c29d-4279-887c-acde5bac4381 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:19.696764 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0ced2a73-c29d-4279-887c-acde5bac4381 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:19.697277 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0ced2a73-c29d-4279-887c-acde5bac4381 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:19.697749 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0ced2a73-c29d-4279-887c-acde5bac4381 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:19.866566 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0ced2a73-c29d-4279-887c-acde5bac4381 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:19.875831 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0ced2a73-c29d-4279-887c-acde5bac4381 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 200 len: 1736 microversion: 2.1 time: 0.193061 Sep 01 16:40:19.876447 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 275/577] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:19 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 1736 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:20.603950 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-69c0f8f2-e313-4ca1-9a9d-31aa230d70ca tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:20.605066 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-69c0f8f2-e313-4ca1-9a9d-31aa230d70ca tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: 8055f17c-aded-4b3d-99b4-6ad010bb0e77] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:20.607950 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:20.615060 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-69c0f8f2-e313-4ca1-9a9d-31aa230d70ca tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:20.615715 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-69c0f8f2-e313-4ca1-9a9d-31aa230d70ca tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:20.616296 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-69c0f8f2-e313-4ca1-9a9d-31aa230d70ca tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:20.617247 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-69c0f8f2-e313-4ca1-9a9d-31aa230d70ca tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:20.617888 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-69c0f8f2-e313-4ca1-9a9d-31aa230d70ca tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:20.618510 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-69c0f8f2-e313-4ca1-9a9d-31aa230d70ca tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:20.694692 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-69c0f8f2-e313-4ca1-9a9d-31aa230d70ca tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:20.703692 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-69c0f8f2-e313-4ca1-9a9d-31aa230d70ca tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77" status: 200 len: 1294 microversion: 2.1 time: 0.106119 Sep 01 16:40:20.704341 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 303/578] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:20 2022] GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77 => generated 1294 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:20.898379 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-37cf6047-65b0-4c7c-8bb6-c544c420f1e0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:20.899021 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-37cf6047-65b0-4c7c-8bb6-c544c420f1e0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:20.907101 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-37cf6047-65b0-4c7c-8bb6-c544c420f1e0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:20.907782 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-37cf6047-65b0-4c7c-8bb6-c544c420f1e0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:20.908438 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-37cf6047-65b0-4c7c-8bb6-c544c420f1e0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:20.914493 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-37cf6047-65b0-4c7c-8bb6-c544c420f1e0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:20.915145 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-37cf6047-65b0-4c7c-8bb6-c544c420f1e0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:20.916024 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-37cf6047-65b0-4c7c-8bb6-c544c420f1e0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:21.112154 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-37cf6047-65b0-4c7c-8bb6-c544c420f1e0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:21.121396 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-37cf6047-65b0-4c7c-8bb6-c544c420f1e0 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 200 len: 1736 microversion: 2.1 time: 0.227792 Sep 01 16:40:21.121974 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 276/579] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:20 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 1736 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:21.728630 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a00ab042-0e95-4af9-839c-fdf709752fba tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:21.730696 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-a00ab042-0e95-4af9-839c-fdf709752fba tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: 8055f17c-aded-4b3d-99b4-6ad010bb0e77] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:21.738713 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a00ab042-0e95-4af9-839c-fdf709752fba tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:21.739246 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a00ab042-0e95-4af9-839c-fdf709752fba tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:21.739945 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a00ab042-0e95-4af9-839c-fdf709752fba tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:21.740752 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a00ab042-0e95-4af9-839c-fdf709752fba tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:21.741296 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a00ab042-0e95-4af9-839c-fdf709752fba tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:21.742001 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a00ab042-0e95-4af9-839c-fdf709752fba tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:21.963760 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-a00ab042-0e95-4af9-839c-fdf709752fba tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:21.973647 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-a00ab042-0e95-4af9-839c-fdf709752fba tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77" status: 200 len: 1367 microversion: 2.1 time: 0.250238 Sep 01 16:40:21.974750 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 304/580] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:21 2022] GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77 => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:22.145077 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-75ad4e82-0aa5-4301-a6ff-a061255ab752 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:22.145688 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-75ad4e82-0aa5-4301-a6ff-a061255ab752 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:22.153044 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-75ad4e82-0aa5-4301-a6ff-a061255ab752 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:22.153564 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-75ad4e82-0aa5-4301-a6ff-a061255ab752 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:22.154004 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-75ad4e82-0aa5-4301-a6ff-a061255ab752 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:22.154717 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-75ad4e82-0aa5-4301-a6ff-a061255ab752 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:22.155282 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-75ad4e82-0aa5-4301-a6ff-a061255ab752 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:22.155710 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-75ad4e82-0aa5-4301-a6ff-a061255ab752 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:22.406459 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-75ad4e82-0aa5-4301-a6ff-a061255ab752 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:22.416673 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-75ad4e82-0aa5-4301-a6ff-a061255ab752 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 200 len: 1736 microversion: 2.1 time: 0.275482 Sep 01 16:40:22.418017 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 277/581] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:22 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 1736 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:22.581932 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-b39ea7cf-95bf-4152-bced-681d2c5649c6 req-a9980e0a-f863-4704-b646-d95537ad339a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8055f17c-aded-4b3d-99b4-6ad010bb0e77", "tag": "c8924c93-a074-4f3a-82f3-f2e637b26f42"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:22.594941 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-b39ea7cf-95bf-4152-bced-681d2c5649c6 req-a9980e0a-f863-4704-b646-d95537ad339a service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:22.596757 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-b39ea7cf-95bf-4152-bced-681d2c5649c6 req-a9980e0a-f863-4704-b646-d95537ad339a service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:22.597429 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-b39ea7cf-95bf-4152-bced-681d2c5649c6 req-a9980e0a-f863-4704-b646-d95537ad339a service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:22.614105 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-b39ea7cf-95bf-4152-bced-681d2c5649c6 req-a9980e0a-f863-4704-b646-d95537ad339a service nova] Creating event network-changed:c8924c93-a074-4f3a-82f3-f2e637b26f42 for instance 8055f17c-aded-4b3d-99b4-6ad010bb0e77 on hv-cinder-85221 Sep 01 16:40:22.619812 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-b39ea7cf-95bf-4152-bced-681d2c5649c6 req-a9980e0a-f863-4704-b646-d95537ad339a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047933 Sep 01 16:40:22.621187 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 305/582] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:40:23.002262 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d61fd81f-cd3e-4cf6-bf91-fbf28218e698 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:23.003992 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d61fd81f-cd3e-4cf6-bf91-fbf28218e698 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: 8055f17c-aded-4b3d-99b4-6ad010bb0e77] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:23.015572 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d61fd81f-cd3e-4cf6-bf91-fbf28218e698 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:23.017174 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d61fd81f-cd3e-4cf6-bf91-fbf28218e698 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:23.018629 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d61fd81f-cd3e-4cf6-bf91-fbf28218e698 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:23.020286 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d61fd81f-cd3e-4cf6-bf91-fbf28218e698 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:23.021347 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d61fd81f-cd3e-4cf6-bf91-fbf28218e698 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:23.022831 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d61fd81f-cd3e-4cf6-bf91-fbf28218e698 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:23.219744 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d61fd81f-cd3e-4cf6-bf91-fbf28218e698 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:23.227734 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d61fd81f-cd3e-4cf6-bf91-fbf28218e698 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77" status: 200 len: 1367 microversion: 2.1 time: 0.235574 Sep 01 16:40:23.228465 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 278/583] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:22 2022] GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77 => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:23.439386 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-73178f16-5e65-475b-964c-6b813082e99b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:23.441221 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-73178f16-5e65-475b-964c-6b813082e99b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:23.446342 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-73178f16-5e65-475b-964c-6b813082e99b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:23.446832 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-73178f16-5e65-475b-964c-6b813082e99b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:23.447237 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-73178f16-5e65-475b-964c-6b813082e99b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:23.447950 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-73178f16-5e65-475b-964c-6b813082e99b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:23.448397 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-73178f16-5e65-475b-964c-6b813082e99b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:23.448815 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-73178f16-5e65-475b-964c-6b813082e99b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:23.611357 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-73178f16-5e65-475b-964c-6b813082e99b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:23.634361 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-73178f16-5e65-475b-964c-6b813082e99b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 200 len: 1736 microversion: 2.1 time: 0.199106 Sep 01 16:40:23.635154 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 306/584] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:23 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 1736 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:24.250783 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-18ed3c91-668f-45b1-98c6-05a864f51ddf tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:24.251379 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-18ed3c91-668f-45b1-98c6-05a864f51ddf tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: 8055f17c-aded-4b3d-99b4-6ad010bb0e77] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:24.258291 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-18ed3c91-668f-45b1-98c6-05a864f51ddf tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:24.258782 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-18ed3c91-668f-45b1-98c6-05a864f51ddf tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:24.259217 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-18ed3c91-668f-45b1-98c6-05a864f51ddf tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:24.259944 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-18ed3c91-668f-45b1-98c6-05a864f51ddf tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:24.260404 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-18ed3c91-668f-45b1-98c6-05a864f51ddf tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:24.261065 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-18ed3c91-668f-45b1-98c6-05a864f51ddf tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:24.466404 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-18ed3c91-668f-45b1-98c6-05a864f51ddf tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:24.475993 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-18ed3c91-668f-45b1-98c6-05a864f51ddf tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77" status: 200 len: 1367 microversion: 2.1 time: 0.229959 Sep 01 16:40:24.476580 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 279/585] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:24 2022] GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77 => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:24.658041 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-f4ca9a47-2f73-492f-b137-53f8ab330b7f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:24.658696 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-f4ca9a47-2f73-492f-b137-53f8ab330b7f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:24.665145 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f4ca9a47-2f73-492f-b137-53f8ab330b7f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:24.665632 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f4ca9a47-2f73-492f-b137-53f8ab330b7f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:24.666092 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f4ca9a47-2f73-492f-b137-53f8ab330b7f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:24.666791 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f4ca9a47-2f73-492f-b137-53f8ab330b7f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:24.667240 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f4ca9a47-2f73-492f-b137-53f8ab330b7f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:24.667650 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f4ca9a47-2f73-492f-b137-53f8ab330b7f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:24.808764 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-f4ca9a47-2f73-492f-b137-53f8ab330b7f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:24.817295 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-f4ca9a47-2f73-492f-b137-53f8ab330b7f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 200 len: 1736 microversion: 2.1 time: 0.163312 Sep 01 16:40:24.817876 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 307/586] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:24 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:25.501584 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-17f2c043-c552-440c-b868-888f8847c511 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:25.502235 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-17f2c043-c552-440c-b868-888f8847c511 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: 8055f17c-aded-4b3d-99b4-6ad010bb0e77] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:25.510612 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-17f2c043-c552-440c-b868-888f8847c511 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:25.511378 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-17f2c043-c552-440c-b868-888f8847c511 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:25.512112 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-17f2c043-c552-440c-b868-888f8847c511 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:25.513206 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-17f2c043-c552-440c-b868-888f8847c511 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:25.513933 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-17f2c043-c552-440c-b868-888f8847c511 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:25.514900 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-17f2c043-c552-440c-b868-888f8847c511 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:25.657958 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-17f2c043-c552-440c-b868-888f8847c511 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:25.666414 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-17f2c043-c552-440c-b868-888f8847c511 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77" status: 200 len: 1367 microversion: 2.1 time: 0.169348 Sep 01 16:40:25.666994 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 280/587] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:25 2022] GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:25.842415 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e9ecdc7c-1097-4653-af6c-97f06b897f3b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:25.843573 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e9ecdc7c-1097-4653-af6c-97f06b897f3b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:25.850102 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e9ecdc7c-1097-4653-af6c-97f06b897f3b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:25.850508 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e9ecdc7c-1097-4653-af6c-97f06b897f3b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:25.850941 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e9ecdc7c-1097-4653-af6c-97f06b897f3b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:25.851648 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e9ecdc7c-1097-4653-af6c-97f06b897f3b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:25.852139 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e9ecdc7c-1097-4653-af6c-97f06b897f3b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:25.852560 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e9ecdc7c-1097-4653-af6c-97f06b897f3b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:25.990754 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-e9ecdc7c-1097-4653-af6c-97f06b897f3b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:25.999234 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e9ecdc7c-1097-4653-af6c-97f06b897f3b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 200 len: 1736 microversion: 2.1 time: 0.163184 Sep 01 16:40:26.000402 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 308/588] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:25 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:26.688713 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-803b325f-f0d8-4b5c-965d-e2a70eaf8a23 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:26.689322 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-803b325f-f0d8-4b5c-965d-e2a70eaf8a23 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: 8055f17c-aded-4b3d-99b4-6ad010bb0e77] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:26.696234 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-803b325f-f0d8-4b5c-965d-e2a70eaf8a23 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:26.696725 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-803b325f-f0d8-4b5c-965d-e2a70eaf8a23 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:26.697155 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-803b325f-f0d8-4b5c-965d-e2a70eaf8a23 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:26.697840 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-803b325f-f0d8-4b5c-965d-e2a70eaf8a23 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:26.698355 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-803b325f-f0d8-4b5c-965d-e2a70eaf8a23 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:26.698805 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-803b325f-f0d8-4b5c-965d-e2a70eaf8a23 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:26.837169 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-803b325f-f0d8-4b5c-965d-e2a70eaf8a23 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:26.846545 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-803b325f-f0d8-4b5c-965d-e2a70eaf8a23 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77" status: 200 len: 1367 microversion: 2.1 time: 0.161877 Sep 01 16:40:26.847141 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 281/589] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:26 2022] GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:27.022341 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-f2b3d941-bfb1-43f0-8262-da65889ebee8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:27.022922 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-f2b3d941-bfb1-43f0-8262-da65889ebee8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:27.029583 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f2b3d941-bfb1-43f0-8262-da65889ebee8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:27.030065 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f2b3d941-bfb1-43f0-8262-da65889ebee8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:27.030491 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f2b3d941-bfb1-43f0-8262-da65889ebee8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:27.031413 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f2b3d941-bfb1-43f0-8262-da65889ebee8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:27.032046 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f2b3d941-bfb1-43f0-8262-da65889ebee8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:27.032471 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f2b3d941-bfb1-43f0-8262-da65889ebee8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:27.172236 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-f2b3d941-bfb1-43f0-8262-da65889ebee8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:27.181078 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-f2b3d941-bfb1-43f0-8262-da65889ebee8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 200 len: 1736 microversion: 2.1 time: 0.162682 Sep 01 16:40:27.181844 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 309/590] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:27 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:27.867668 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-055d6120-aa8a-4d5d-bc53-887173aa4853 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:27.868430 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-055d6120-aa8a-4d5d-bc53-887173aa4853 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: 8055f17c-aded-4b3d-99b4-6ad010bb0e77] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:27.877039 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-055d6120-aa8a-4d5d-bc53-887173aa4853 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:27.877533 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-055d6120-aa8a-4d5d-bc53-887173aa4853 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:27.877973 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-055d6120-aa8a-4d5d-bc53-887173aa4853 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:27.878686 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-055d6120-aa8a-4d5d-bc53-887173aa4853 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:27.879280 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-055d6120-aa8a-4d5d-bc53-887173aa4853 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:27.879759 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-055d6120-aa8a-4d5d-bc53-887173aa4853 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:27.932871 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-cd52b457-d559-46ec-b37d-05f29e9a7042 req-13e2adbb-b325-4002-bff5-abf094537539 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8055f17c-aded-4b3d-99b4-6ad010bb0e77", "name": "network-vif-plugged", "status": "completed", "tag": "c8924c93-a074-4f3a-82f3-f2e637b26f42"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:27.949557 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-cd52b457-d559-46ec-b37d-05f29e9a7042 req-13e2adbb-b325-4002-bff5-abf094537539 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:27.950418 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-cd52b457-d559-46ec-b37d-05f29e9a7042 req-13e2adbb-b325-4002-bff5-abf094537539 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:27.950821 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-cd52b457-d559-46ec-b37d-05f29e9a7042 req-13e2adbb-b325-4002-bff5-abf094537539 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:27.964455 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-cd52b457-d559-46ec-b37d-05f29e9a7042 req-13e2adbb-b325-4002-bff5-abf094537539 service nova] Creating event network-vif-plugged:c8924c93-a074-4f3a-82f3-f2e637b26f42 for instance 8055f17c-aded-4b3d-99b4-6ad010bb0e77 on hv-cinder-85221 Sep 01 16:40:27.970658 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-cd52b457-d559-46ec-b37d-05f29e9a7042 req-13e2adbb-b325-4002-bff5-abf094537539 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046744 Sep 01 16:40:27.971457 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 310/591] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:40:28.036806 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-055d6120-aa8a-4d5d-bc53-887173aa4853 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:28.045263 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-055d6120-aa8a-4d5d-bc53-887173aa4853 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77" status: 200 len: 1367 microversion: 2.1 time: 0.181582 Sep 01 16:40:28.045849 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 282/592] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:27 2022] GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:28.208937 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-70cba030-f264-4256-b4b9-2d846095aebb tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:28.209609 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-70cba030-f264-4256-b4b9-2d846095aebb tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:28.216460 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-70cba030-f264-4256-b4b9-2d846095aebb tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:28.216941 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-70cba030-f264-4256-b4b9-2d846095aebb tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:28.217565 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-70cba030-f264-4256-b4b9-2d846095aebb tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:28.218372 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-70cba030-f264-4256-b4b9-2d846095aebb tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:28.219475 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-70cba030-f264-4256-b4b9-2d846095aebb tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:28.219906 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-70cba030-f264-4256-b4b9-2d846095aebb tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:28.737894 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-70cba030-f264-4256-b4b9-2d846095aebb tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:28.748585 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-70cba030-f264-4256-b4b9-2d846095aebb tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 200 len: 1716 microversion: 2.1 time: 0.543594 Sep 01 16:40:28.749196 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 311/593] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:28 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 1716 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:28.872839 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d8a42f1a-f046-46ec-82c7-142c3cdd1d39 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:28.873405 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d8a42f1a-f046-46ec-82c7-142c3cdd1d39 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:28.881091 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d8a42f1a-f046-46ec-82c7-142c3cdd1d39 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:28.881655 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d8a42f1a-f046-46ec-82c7-142c3cdd1d39 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:28.882034 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d8a42f1a-f046-46ec-82c7-142c3cdd1d39 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:28.882730 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d8a42f1a-f046-46ec-82c7-142c3cdd1d39 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:28.883178 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d8a42f1a-f046-46ec-82c7-142c3cdd1d39 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:28.883594 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d8a42f1a-f046-46ec-82c7-142c3cdd1d39 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:28.973870 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-d8a42f1a-f046-46ec-82c7-142c3cdd1d39 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] HTTP exception thrown: Cannot 'detach_volume' instance f85533a0-bc5b-465a-895d-a473efbb0859 while it is in vm_state rescued Sep 01 16:40:28.975379 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d8a42f1a-f046-46ec-82c7-142c3cdd1d39 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Request method failure captured: Sep 01 16:40:28.975379 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: request: DELETE /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859/os-volume_attachments/5d2778d3-fed1-443a-9216-1350fc7e81b1 HTTP/1.1 Sep 01 16:40:28.975379 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 01 16:40:28.975379 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 01 16:40:28.975379 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Connection: close Sep 01 16:40:28.975379 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 01 16:40:28.975379 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 01 16:40:28.975379 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Host: 10.222.0.62 Sep 01 16:40:28.975379 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 01 16:40:28.975379 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 01 16:40:28.975379 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjEN-Hts0Mr9WeZLVVha0OUabTAqWGElr--EmdAiOOM-cApKNFGz-VYPGEBh-XtHr4mngp8wOv7uR2S1_H1kjugmtEeioWaKFgQasL22TUHp0ruIbb4qLL0bIAqzf73Vb_OIQurxRZ_z3v0E35M_p2nrgRTWzIx_SloZcsKtKtINXJHVs Sep 01 16:40:28.975379 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 01 16:40:28.975379 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 01 16:40:28.975379 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 01 16:40:28.975379 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 01 16:40:28.975379 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 01 16:40:28.975379 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 01 16:40:28.975379 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Id: 601c248b5d9b48488351cb4d9561a2f4 Sep 01 16:40:28.975379 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-120173524 Sep 01 16:40:28.975379 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 01 16:40:28.975379 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 01 16:40:28.976766 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/601c248b5d9b48488351cb4d9561a2f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/601c248b5d9b48488351cb4d9561a2f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_601c248b5d9b48488351cb4d9561a2f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/601c248b5d9b48488351cb4d9561a2f4"}]}] Sep 01 16:40:28.976766 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-ServerRescueNegativeTestJSON-120173524 Sep 01 16:40:28.976766 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Id: 601c248b5d9b48488351cb4d9561a2f4 Sep 01 16:40:28.976766 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-120173524 Sep 01 16:40:28.976766 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User: tempest-ServerRescueNegativeTestJSON-120173524-project Sep 01 16:40:28.976766 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 01 16:40:28.976766 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 01 16:40:28.976766 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Id: 52760b6736e14ccd8df8aca0015cb292 Sep 01 16:40:28.976766 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-ServerRescueNegativeTestJSON-120173524-project Sep 01 16:40:28.976766 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: method: > Sep 01 16:40:28.976766 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: exception: Cannot 'detach_volume' instance f85533a0-bc5b-465a-895d-a473efbb0859 while it is in vm_state rescued Sep 01 16:40:28.977422 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: action_args: {'server_id': 'f85533a0-bc5b-465a-895d-a473efbb0859', 'id': '5d2778d3-fed1-443a-9216-1350fc7e81b1'} Sep 01 16:40:28.977422 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:40:28.977422 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:28.977422 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 01 16:40:28.977422 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 01 16:40:28.977422 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 16:40:28.977422 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 16:40:28.977422 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 16:40:28.977422 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 16:40:28.977422 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f85533a0-bc5b-465a-895d-a473efbb0859 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 01 16:40:28.977422 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:40:28.977422 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:40:28.977422 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:40:28.977422 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:28.977422 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:40:28.977422 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:40:28.977422 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:40:28.977422 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:40:28.977422 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:40:28.977422 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:40:28.979059 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 01 16:40:28.979059 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 16:40:28.979059 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 16:40:28.979059 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 16:40:28.979059 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance f85533a0-bc5b-465a-895d-a473efbb0859 while it is in vm_state rescued Sep 01 16:40:28.979059 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:40:28.979059 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:40:28.979059 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:40:28.979059 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:28.979059 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:40:28.979059 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:40:28.979059 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:40:28.979059 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:40:28.979059 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance f85533a0-bc5b-465a-895d-a473efbb0859 while it is in vm_state rescued Sep 01 16:40:28.979059 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:40:28.979059 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d8a42f1a-f046-46ec-82c7-142c3cdd1d39 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Returning 409 to user: Cannot 'detach_volume' instance f85533a0-bc5b-465a-895d-a473efbb0859 while it is in vm_state rescued {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:40:28.980516 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d8a42f1a-f046-46ec-82c7-142c3cdd1d39 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "DELETE /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859/os-volume_attachments/5d2778d3-fed1-443a-9216-1350fc7e81b1" status: 409 len: 152 microversion: 2.1 time: 0.108420 Sep 01 16:40:28.980516 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 283/594] 10.222.0.62 () {58 vars in 1416 bytes} [Thu Sep 1 16:40:28 2022] DELETE /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859/os-volume_attachments/5d2778d3-fed1-443a-9216-1350fc7e81b1 => generated 152 bytes in 113 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 01 16:40:28.986967 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a0a764f9-24f9-4fae-b424-f9d818f8d441 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:28.987444 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-a0a764f9-24f9-4fae-b424-f9d818f8d441 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:28.993882 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a0a764f9-24f9-4fae-b424-f9d818f8d441 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:28.994362 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a0a764f9-24f9-4fae-b424-f9d818f8d441 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:28.994791 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a0a764f9-24f9-4fae-b424-f9d818f8d441 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:28.995482 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a0a764f9-24f9-4fae-b424-f9d818f8d441 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:28.995980 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a0a764f9-24f9-4fae-b424-f9d818f8d441 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:28.996402 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a0a764f9-24f9-4fae-b424-f9d818f8d441 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:29.050506 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-263c19e7-6056-4646-856a-9194db3f2832 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:29.051420 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-263c19e7-6056-4646-856a-9194db3f2832 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:29.058070 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-263c19e7-6056-4646-856a-9194db3f2832 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:29.058556 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-263c19e7-6056-4646-856a-9194db3f2832 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:29.059003 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-263c19e7-6056-4646-856a-9194db3f2832 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:29.060323 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-263c19e7-6056-4646-856a-9194db3f2832 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:29.060905 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-263c19e7-6056-4646-856a-9194db3f2832 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:29.061524 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-263c19e7-6056-4646-856a-9194db3f2832 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:29.072199 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-a0a764f9-24f9-4fae-b424-f9d818f8d441 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "POST /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859/action" status: 202 len: 0 microversion: 2.1 time: 0.089275 Sep 01 16:40:29.076522 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 312/595] 10.222.0.62 () {60 vars in 1278 bytes} [Thu Sep 1 16:40:28 2022] POST /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:40:29.079254 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-dd1e98e9-3291-4a5f-8f7d-629436342d96 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:29.079955 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-dd1e98e9-3291-4a5f-8f7d-629436342d96 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: 8055f17c-aded-4b3d-99b4-6ad010bb0e77] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:29.086502 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dd1e98e9-3291-4a5f-8f7d-629436342d96 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:29.087032 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dd1e98e9-3291-4a5f-8f7d-629436342d96 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:29.087507 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dd1e98e9-3291-4a5f-8f7d-629436342d96 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:29.088241 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dd1e98e9-3291-4a5f-8f7d-629436342d96 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:29.088887 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dd1e98e9-3291-4a5f-8f7d-629436342d96 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:29.089211 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dd1e98e9-3291-4a5f-8f7d-629436342d96 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:29.100759 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-263c19e7-6056-4646-856a-9194db3f2832 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a/os-volume_attachments/ea5a42f4-034a-423f-a942-d2e11eb85d91" status: 200 len: 194 microversion: 2.20 time: 0.055813 Sep 01 16:40:29.101376 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 284/596] 10.222.0.62 () {60 vars in 1454 bytes} [Thu Sep 1 16:40:29 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a/os-volume_attachments/ea5a42f4-034a-423f-a942-d2e11eb85d91 => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:40:29.106527 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:29.113407 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1a49fb54-8842-4fae-9dfa-170396a10eca tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:29.114559 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1a49fb54-8842-4fae-9dfa-170396a10eca tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:29.124248 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1a49fb54-8842-4fae-9dfa-170396a10eca tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:29.125254 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1a49fb54-8842-4fae-9dfa-170396a10eca tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:29.126024 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1a49fb54-8842-4fae-9dfa-170396a10eca tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:29.127046 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1a49fb54-8842-4fae-9dfa-170396a10eca tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:29.127825 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1a49fb54-8842-4fae-9dfa-170396a10eca tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:29.129001 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1a49fb54-8842-4fae-9dfa-170396a10eca tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:29.328742 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-dd1e98e9-3291-4a5f-8f7d-629436342d96 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:29.333637 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1a49fb54-8842-4fae-9dfa-170396a10eca tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:29.336676 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:29.337404 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-dd1e98e9-3291-4a5f-8f7d-629436342d96 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77" status: 200 len: 1367 microversion: 2.1 time: 0.263249 Sep 01 16:40:29.338196 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 313/597] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:29 2022] GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77 => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:29.343484 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-189aa555-cfcc-4e21-b083-55af2db51f92 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:29.343995 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-189aa555-cfcc-4e21-b083-55af2db51f92 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:29.345531 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1a49fb54-8842-4fae-9dfa-170396a10eca tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 200 len: 1724 microversion: 2.1 time: 0.243107 Sep 01 16:40:29.346561 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 285/598] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:29 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:29.350688 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-189aa555-cfcc-4e21-b083-55af2db51f92 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:29.351402 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-189aa555-cfcc-4e21-b083-55af2db51f92 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:29.352203 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-189aa555-cfcc-4e21-b083-55af2db51f92 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:29.352915 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-189aa555-cfcc-4e21-b083-55af2db51f92 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:29.353379 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-189aa555-cfcc-4e21-b083-55af2db51f92 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:29.353788 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-189aa555-cfcc-4e21-b083-55af2db51f92 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:29.495228 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.objects.instance [None req-189aa555-cfcc-4e21-b083-55af2db51f92 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lazy-loading 'services' on Instance uuid 8ddc2614-8a62-4c61-a086-8dbab65e1f4a {{(pid=127199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:40:29.575426 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=6 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:29.625108 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-189aa555-cfcc-4e21-b083-55af2db51f92 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "DELETE /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a/os-volume_attachments/ea5a42f4-034a-423f-a942-d2e11eb85d91" status: 202 len: 0 microversion: 2.20 time: 0.285363 Sep 01 16:40:29.625815 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 314/599] 10.222.0.62 () {60 vars in 1457 bytes} [Thu Sep 1 16:40:29 2022] DELETE /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a/os-volume_attachments/ea5a42f4-034a-423f-a942-d2e11eb85d91 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:40:29.635103 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ba7f2f35-e5ef-4199-9e9b-e40f6e77b51e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:29.637881 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ba7f2f35-e5ef-4199-9e9b-e40f6e77b51e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:29.640153 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:29.640926 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=6 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:29.649265 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ba7f2f35-e5ef-4199-9e9b-e40f6e77b51e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:29.649829 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ba7f2f35-e5ef-4199-9e9b-e40f6e77b51e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:29.650438 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ba7f2f35-e5ef-4199-9e9b-e40f6e77b51e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:29.651159 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ba7f2f35-e5ef-4199-9e9b-e40f6e77b51e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:29.651614 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ba7f2f35-e5ef-4199-9e9b-e40f6e77b51e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:29.652066 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ba7f2f35-e5ef-4199-9e9b-e40f6e77b51e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:29.686772 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ba7f2f35-e5ef-4199-9e9b-e40f6e77b51e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055982 Sep 01 16:40:29.687598 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 286/600] 10.222.0.62 () {60 vars in 1343 bytes} [Thu Sep 1 16:40:29 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:40:30.360490 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-310316b1-a90b-464b-9397-3c91fad8d1ed tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:30.361310 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-310316b1-a90b-464b-9397-3c91fad8d1ed tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: 8055f17c-aded-4b3d-99b4-6ad010bb0e77] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:30.368240 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-310316b1-a90b-464b-9397-3c91fad8d1ed tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:30.368745 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-310316b1-a90b-464b-9397-3c91fad8d1ed tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:30.369178 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-310316b1-a90b-464b-9397-3c91fad8d1ed tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:30.369916 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-310316b1-a90b-464b-9397-3c91fad8d1ed tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:30.370372 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-310316b1-a90b-464b-9397-3c91fad8d1ed tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:30.370539 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a27312cb-46a6-4950-9874-2067bd98b93a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:30.370999 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-310316b1-a90b-464b-9397-3c91fad8d1ed tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:30.371515 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a27312cb-46a6-4950-9874-2067bd98b93a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:30.386405 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a27312cb-46a6-4950-9874-2067bd98b93a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:30.387209 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a27312cb-46a6-4950-9874-2067bd98b93a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:30.388020 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a27312cb-46a6-4950-9874-2067bd98b93a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:30.389216 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a27312cb-46a6-4950-9874-2067bd98b93a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:30.390216 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a27312cb-46a6-4950-9874-2067bd98b93a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:30.391166 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a27312cb-46a6-4950-9874-2067bd98b93a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:30.577964 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-310316b1-a90b-464b-9397-3c91fad8d1ed tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:30.583037 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a27312cb-46a6-4950-9874-2067bd98b93a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:30.586192 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-310316b1-a90b-464b-9397-3c91fad8d1ed tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77" status: 200 len: 1557 microversion: 2.1 time: 0.230098 Sep 01 16:40:30.586773 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 315/601] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:30 2022] GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77 => generated 1557 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:30.593357 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a27312cb-46a6-4950-9874-2067bd98b93a tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 200 len: 1724 microversion: 2.1 time: 0.229194 Sep 01 16:40:30.593357 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 287/602] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:30 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 1724 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:40:30.608967 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8574a42e-a0e8-4be1-a1fe-5f4b697b0f2b tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:30.609767 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-8574a42e-a0e8-4be1-a1fe-5f4b697b0f2b tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: 8055f17c-aded-4b3d-99b4-6ad010bb0e77] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:30.616064 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8574a42e-a0e8-4be1-a1fe-5f4b697b0f2b tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:30.616555 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8574a42e-a0e8-4be1-a1fe-5f4b697b0f2b tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:30.616996 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8574a42e-a0e8-4be1-a1fe-5f4b697b0f2b tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:30.617687 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8574a42e-a0e8-4be1-a1fe-5f4b697b0f2b tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:30.618173 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8574a42e-a0e8-4be1-a1fe-5f4b697b0f2b tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:30.618595 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8574a42e-a0e8-4be1-a1fe-5f4b697b0f2b tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:30.707791 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-578a3fd3-3c27-485a-8213-13a9114eecd8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:30.708571 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8574a42e-a0e8-4be1-a1fe-5f4b697b0f2b tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103501 Sep 01 16:40:30.709274 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 316/603] 10.222.0.62 () {58 vars in 1275 bytes} [Thu Sep 1 16:40:30 2022] GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:40:30.710254 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-578a3fd3-3c27-485a-8213-13a9114eecd8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:30.717341 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-578a3fd3-3c27-485a-8213-13a9114eecd8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:30.717843 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-578a3fd3-3c27-485a-8213-13a9114eecd8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:30.718282 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-578a3fd3-3c27-485a-8213-13a9114eecd8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:30.718999 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-578a3fd3-3c27-485a-8213-13a9114eecd8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:30.719452 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-578a3fd3-3c27-485a-8213-13a9114eecd8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:30.719873 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-578a3fd3-3c27-485a-8213-13a9114eecd8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:30.751828 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-578a3fd3-3c27-485a-8213-13a9114eecd8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054000 Sep 01 16:40:30.752838 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 288/604] 10.222.0.62 () {60 vars in 1343 bytes} [Thu Sep 1 16:40:30 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:40:31.615125 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a867708c-4b50-4087-9b1b-023b7343c889 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:31.615829 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-a867708c-4b50-4087-9b1b-023b7343c889 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:31.622611 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a867708c-4b50-4087-9b1b-023b7343c889 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:31.623077 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a867708c-4b50-4087-9b1b-023b7343c889 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:31.623726 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a867708c-4b50-4087-9b1b-023b7343c889 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:31.624496 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a867708c-4b50-4087-9b1b-023b7343c889 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:31.624954 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a867708c-4b50-4087-9b1b-023b7343c889 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:31.625550 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a867708c-4b50-4087-9b1b-023b7343c889 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:31.769647 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3a25638c-1930-48ce-b90d-55c3b41a3c80 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:31.771991 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-3a25638c-1930-48ce-b90d-55c3b41a3c80 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:31.779742 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3a25638c-1930-48ce-b90d-55c3b41a3c80 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:31.780525 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-a867708c-4b50-4087-9b1b-023b7343c889 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:31.781149 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3a25638c-1930-48ce-b90d-55c3b41a3c80 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:31.781149 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3a25638c-1930-48ce-b90d-55c3b41a3c80 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:31.781999 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3a25638c-1930-48ce-b90d-55c3b41a3c80 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:31.782840 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3a25638c-1930-48ce-b90d-55c3b41a3c80 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:31.783147 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3a25638c-1930-48ce-b90d-55c3b41a3c80 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:31.789726 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-a867708c-4b50-4087-9b1b-023b7343c889 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 200 len: 1724 microversion: 2.1 time: 0.178452 Sep 01 16:40:31.790560 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 317/605] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:31 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:31.818063 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3a25638c-1930-48ce-b90d-55c3b41a3c80 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.056697 Sep 01 16:40:31.818739 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 289/606] 10.222.0.62 () {60 vars in 1343 bytes} [Thu Sep 1 16:40:31 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:31.883059 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e9da539e-28d2-4d7c-8873-e3ce036ece42 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:31.883548 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e9da539e-28d2-4d7c-8873-e3ce036ece42 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:31.889529 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e9da539e-28d2-4d7c-8873-e3ce036ece42 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:31.890111 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e9da539e-28d2-4d7c-8873-e3ce036ece42 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:31.890531 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e9da539e-28d2-4d7c-8873-e3ce036ece42 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:31.891205 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e9da539e-28d2-4d7c-8873-e3ce036ece42 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:31.891639 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e9da539e-28d2-4d7c-8873-e3ce036ece42 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:31.892089 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e9da539e-28d2-4d7c-8873-e3ce036ece42 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:31.917051 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e9da539e-28d2-4d7c-8873-e3ce036ece42 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Going to try to terminate instance {{(pid=127199) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:40:32.002363 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e9da539e-28d2-4d7c-8873-e3ce036ece42 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "DELETE /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 204 len: 0 microversion: 2.20 time: 0.122770 Sep 01 16:40:32.002903 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 318/607] 10.222.0.62 () {60 vars in 1280 bytes} [Thu Sep 1 16:40:31 2022] DELETE /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 16:40:32.011817 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d4d3c6c3-6b74-4ac7-8cc0-a8719559d195 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:32.012567 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d4d3c6c3-6b74-4ac7-8cc0-a8719559d195 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:32.019594 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d4d3c6c3-6b74-4ac7-8cc0-a8719559d195 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:32.020377 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d4d3c6c3-6b74-4ac7-8cc0-a8719559d195 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:32.021280 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d4d3c6c3-6b74-4ac7-8cc0-a8719559d195 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:32.022254 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d4d3c6c3-6b74-4ac7-8cc0-a8719559d195 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:32.022935 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d4d3c6c3-6b74-4ac7-8cc0-a8719559d195 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:32.023485 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d4d3c6c3-6b74-4ac7-8cc0-a8719559d195 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:32.054321 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-8e1b755c-c275-422d-a6c5-c1f29ec8ae4b req-ecdbd09d-3d49-4eee-bf77-7eff47430588 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8055f17c-aded-4b3d-99b4-6ad010bb0e77", "tag": "c8924c93-a074-4f3a-82f3-f2e637b26f42"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:32.065550 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-8e1b755c-c275-422d-a6c5-c1f29ec8ae4b req-ecdbd09d-3d49-4eee-bf77-7eff47430588 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:32.066022 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-8e1b755c-c275-422d-a6c5-c1f29ec8ae4b req-ecdbd09d-3d49-4eee-bf77-7eff47430588 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:32.067147 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-8e1b755c-c275-422d-a6c5-c1f29ec8ae4b req-ecdbd09d-3d49-4eee-bf77-7eff47430588 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:32.079433 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-8e1b755c-c275-422d-a6c5-c1f29ec8ae4b req-ecdbd09d-3d49-4eee-bf77-7eff47430588 service nova] Creating event network-changed:c8924c93-a074-4f3a-82f3-f2e637b26f42 for instance 8055f17c-aded-4b3d-99b4-6ad010bb0e77 on hv-cinder-85221 Sep 01 16:40:32.086094 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-8e1b755c-c275-422d-a6c5-c1f29ec8ae4b req-ecdbd09d-3d49-4eee-bf77-7eff47430588 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036488 Sep 01 16:40:32.086693 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 319/608] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:40:32.172038 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d4d3c6c3-6b74-4ac7-8cc0-a8719559d195 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:32.180907 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d4d3c6c3-6b74-4ac7-8cc0-a8719559d195 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:32.182331 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d4d3c6c3-6b74-4ac7-8cc0-a8719559d195 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:32.183499 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d4d3c6c3-6b74-4ac7-8cc0-a8719559d195 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1725 microversion: 2.20 time: 0.176181 Sep 01 16:40:32.184123 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 290/609] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:32 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:32.812111 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8e3de97a-bdc3-4668-aec0-5b994161119e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:32.813138 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-8e3de97a-bdc3-4668-aec0-5b994161119e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:32.820336 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8e3de97a-bdc3-4668-aec0-5b994161119e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:32.821060 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8e3de97a-bdc3-4668-aec0-5b994161119e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:32.821265 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8e3de97a-bdc3-4668-aec0-5b994161119e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:32.821994 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8e3de97a-bdc3-4668-aec0-5b994161119e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:32.822572 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8e3de97a-bdc3-4668-aec0-5b994161119e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:32.823023 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8e3de97a-bdc3-4668-aec0-5b994161119e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:32.974463 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8e3de97a-bdc3-4668-aec0-5b994161119e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:32.982911 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8e3de97a-bdc3-4668-aec0-5b994161119e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 200 len: 1724 microversion: 2.1 time: 0.175264 Sep 01 16:40:32.983715 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 320/610] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:32 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:33.209564 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7c6d2075-79c0-4ba2-9839-0a501ec7b491 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:33.210170 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7c6d2075-79c0-4ba2-9839-0a501ec7b491 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:33.218644 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7c6d2075-79c0-4ba2-9839-0a501ec7b491 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:33.219249 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7c6d2075-79c0-4ba2-9839-0a501ec7b491 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:33.219741 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7c6d2075-79c0-4ba2-9839-0a501ec7b491 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:33.220619 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7c6d2075-79c0-4ba2-9839-0a501ec7b491 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:33.221291 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7c6d2075-79c0-4ba2-9839-0a501ec7b491 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:33.221771 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7c6d2075-79c0-4ba2-9839-0a501ec7b491 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:33.370374 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7c6d2075-79c0-4ba2-9839-0a501ec7b491 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:33.382040 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7c6d2075-79c0-4ba2-9839-0a501ec7b491 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:33.383590 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7c6d2075-79c0-4ba2-9839-0a501ec7b491 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:33.385158 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7c6d2075-79c0-4ba2-9839-0a501ec7b491 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1725 microversion: 2.20 time: 0.180007 Sep 01 16:40:33.385887 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 291/611] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:33 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:34.008414 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-fd8aac65-d583-433a-8d3f-fdac90034743 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:34.009067 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-fd8aac65-d583-433a-8d3f-fdac90034743 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:34.017469 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fd8aac65-d583-433a-8d3f-fdac90034743 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:34.017955 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fd8aac65-d583-433a-8d3f-fdac90034743 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:34.018383 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fd8aac65-d583-433a-8d3f-fdac90034743 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:34.019068 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fd8aac65-d583-433a-8d3f-fdac90034743 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:34.019516 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fd8aac65-d583-433a-8d3f-fdac90034743 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:34.019999 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fd8aac65-d583-433a-8d3f-fdac90034743 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:34.166551 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-fd8aac65-d583-433a-8d3f-fdac90034743 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:34.181346 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-fd8aac65-d583-433a-8d3f-fdac90034743 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 200 len: 1724 microversion: 2.1 time: 0.178971 Sep 01 16:40:34.182239 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 321/612] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:34 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:34.414600 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-4f94c364-0353-498e-ac89-3d7704cc4534 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:34.415398 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-4f94c364-0353-498e-ac89-3d7704cc4534 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:34.422490 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4f94c364-0353-498e-ac89-3d7704cc4534 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:34.423047 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4f94c364-0353-498e-ac89-3d7704cc4534 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:34.423478 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4f94c364-0353-498e-ac89-3d7704cc4534 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:34.424269 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4f94c364-0353-498e-ac89-3d7704cc4534 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:34.424721 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4f94c364-0353-498e-ac89-3d7704cc4534 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:34.425137 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4f94c364-0353-498e-ac89-3d7704cc4534 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:34.574741 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-4f94c364-0353-498e-ac89-3d7704cc4534 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:34.583607 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-4f94c364-0353-498e-ac89-3d7704cc4534 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:34.585148 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-4f94c364-0353-498e-ac89-3d7704cc4534 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:34.586307 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-4f94c364-0353-498e-ac89-3d7704cc4534 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1725 microversion: 2.20 time: 0.177421 Sep 01 16:40:34.586863 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 292/613] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:34 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:40:35.206848 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-abc5d49f-339d-4a17-9ac5-fadcf0f7b20f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:35.207397 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-abc5d49f-339d-4a17-9ac5-fadcf0f7b20f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:35.213790 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-abc5d49f-339d-4a17-9ac5-fadcf0f7b20f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:35.214282 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-abc5d49f-339d-4a17-9ac5-fadcf0f7b20f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:35.214715 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-abc5d49f-339d-4a17-9ac5-fadcf0f7b20f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:35.215472 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-abc5d49f-339d-4a17-9ac5-fadcf0f7b20f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:35.215959 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-abc5d49f-339d-4a17-9ac5-fadcf0f7b20f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:35.216624 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-abc5d49f-339d-4a17-9ac5-fadcf0f7b20f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:35.537538 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-abc5d49f-339d-4a17-9ac5-fadcf0f7b20f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:35.546844 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-abc5d49f-339d-4a17-9ac5-fadcf0f7b20f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 200 len: 1730 microversion: 2.1 time: 0.344270 Sep 01 16:40:35.547670 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 322/614] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:35 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 1730 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:35.568461 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-17dc9fde-3865-430e-b5f9-02e9aaddefdc tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:35.569086 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-17dc9fde-3865-430e-b5f9-02e9aaddefdc tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:35.576215 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-17dc9fde-3865-430e-b5f9-02e9aaddefdc tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:35.576701 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-17dc9fde-3865-430e-b5f9-02e9aaddefdc tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:35.577125 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-17dc9fde-3865-430e-b5f9-02e9aaddefdc tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:35.577831 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-17dc9fde-3865-430e-b5f9-02e9aaddefdc tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:35.578278 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-17dc9fde-3865-430e-b5f9-02e9aaddefdc tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:35.578701 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-17dc9fde-3865-430e-b5f9-02e9aaddefdc tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:35.609988 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-51e5b6de-4fd3-45b4-9a3c-74ee54103135 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:35.610618 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-51e5b6de-4fd3-45b4-9a3c-74ee54103135 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:35.617127 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-51e5b6de-4fd3-45b4-9a3c-74ee54103135 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:35.617609 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-51e5b6de-4fd3-45b4-9a3c-74ee54103135 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:35.618089 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-51e5b6de-4fd3-45b4-9a3c-74ee54103135 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:35.618781 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-51e5b6de-4fd3-45b4-9a3c-74ee54103135 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:35.619221 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-51e5b6de-4fd3-45b4-9a3c-74ee54103135 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:35.619630 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-51e5b6de-4fd3-45b4-9a3c-74ee54103135 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:35.735371 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-17dc9fde-3865-430e-b5f9-02e9aaddefdc tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.171133 Sep 01 16:40:35.736072 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 293/615] 10.222.0.62 () {58 vars in 1275 bytes} [Thu Sep 1 16:40:35 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859/os-interface => generated 284 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:40:35.966923 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-51e5b6de-4fd3-45b4-9a3c-74ee54103135 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:35.976058 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-51e5b6de-4fd3-45b4-9a3c-74ee54103135 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:35.977689 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-51e5b6de-4fd3-45b4-9a3c-74ee54103135 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:35.978881 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-51e5b6de-4fd3-45b4-9a3c-74ee54103135 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1725 microversion: 2.20 time: 0.372918 Sep 01 16:40:35.979424 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 323/616] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:35 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1725 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:40:36.460618 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-5666a3a7-77d1-49a4-9943-a6f8910c9229 req-c9e665a7-7415-4bad-af79-ff1b7cc51eef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ddc2614-8a62-4c61-a086-8dbab65e1f4a", "name": "network-vif-deleted", "tag": "9d73b218-5a3f-4e30-9685-717b1fbfe797"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:36.472213 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-5666a3a7-77d1-49a4-9943-a6f8910c9229 req-c9e665a7-7415-4bad-af79-ff1b7cc51eef service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:36.472725 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-5666a3a7-77d1-49a4-9943-a6f8910c9229 req-c9e665a7-7415-4bad-af79-ff1b7cc51eef service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:36.473237 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-5666a3a7-77d1-49a4-9943-a6f8910c9229 req-c9e665a7-7415-4bad-af79-ff1b7cc51eef service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:36.487636 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-5666a3a7-77d1-49a4-9943-a6f8910c9229 req-c9e665a7-7415-4bad-af79-ff1b7cc51eef service nova] Creating event network-vif-deleted:9d73b218-5a3f-4e30-9685-717b1fbfe797 for instance 8ddc2614-8a62-4c61-a086-8dbab65e1f4a on hv-cinder-85221 Sep 01 16:40:36.493758 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-5666a3a7-77d1-49a4-9943-a6f8910c9229 req-c9e665a7-7415-4bad-af79-ff1b7cc51eef service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037834 Sep 01 16:40:36.495245 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 294/617] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:40:36.735116 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-a9b7ce1b-8412-4b59-83b1-fddeaabec37c req-0696ee0c-f1d7-4f7d-8bbb-b8b241c1df70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f85533a0-bc5b-465a-895d-a473efbb0859", "tag": "dd7294aa-e60e-425e-98a5-e2158ff841de"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:36.758543 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-a9b7ce1b-8412-4b59-83b1-fddeaabec37c req-0696ee0c-f1d7-4f7d-8bbb-b8b241c1df70 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:36.759022 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-a9b7ce1b-8412-4b59-83b1-fddeaabec37c req-0696ee0c-f1d7-4f7d-8bbb-b8b241c1df70 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:36.759462 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-a9b7ce1b-8412-4b59-83b1-fddeaabec37c req-0696ee0c-f1d7-4f7d-8bbb-b8b241c1df70 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:36.774643 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-a9b7ce1b-8412-4b59-83b1-fddeaabec37c req-0696ee0c-f1d7-4f7d-8bbb-b8b241c1df70 service nova] Creating event network-changed:dd7294aa-e60e-425e-98a5-e2158ff841de for instance f85533a0-bc5b-465a-895d-a473efbb0859 on hv-cinder-85221 Sep 01 16:40:36.780397 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-a9b7ce1b-8412-4b59-83b1-fddeaabec37c req-0696ee0c-f1d7-4f7d-8bbb-b8b241c1df70 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049010 Sep 01 16:40:36.784229 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 324/618] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:40:37.005137 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8259b18b-e87e-4f7f-8549-809d040efedd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:37.006071 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8259b18b-e87e-4f7f-8549-809d040efedd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:37.013426 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8259b18b-e87e-4f7f-8549-809d040efedd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:37.014762 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8259b18b-e87e-4f7f-8549-809d040efedd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:37.016657 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8259b18b-e87e-4f7f-8549-809d040efedd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:37.017485 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8259b18b-e87e-4f7f-8549-809d040efedd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:37.018476 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8259b18b-e87e-4f7f-8549-809d040efedd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:37.018982 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8259b18b-e87e-4f7f-8549-809d040efedd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:37.060530 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8259b18b-e87e-4f7f-8549-809d040efedd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:37.061286 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8259b18b-e87e-4f7f-8549-809d040efedd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:37.061972 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8259b18b-e87e-4f7f-8549-809d040efedd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:37.063164 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-8259b18b-e87e-4f7f-8549-809d040efedd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lazy-loading 'fault' on Instance uuid 8ddc2614-8a62-4c61-a086-8dbab65e1f4a {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:40:37.113181 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8259b18b-e87e-4f7f-8549-809d040efedd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:37.122473 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8259b18b-e87e-4f7f-8549-809d040efedd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:37.124249 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8259b18b-e87e-4f7f-8549-809d040efedd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:37.125979 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8259b18b-e87e-4f7f-8549-809d040efedd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 200 len: 1372 microversion: 2.20 time: 0.126771 Sep 01 16:40:37.126666 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 295/619] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:36 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 1372 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:38.154329 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-300568ba-2de7-46a7-b6ae-afc625edbda1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:38.155464 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-300568ba-2de7-46a7-b6ae-afc625edbda1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:38.162532 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-300568ba-2de7-46a7-b6ae-afc625edbda1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:38.163025 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-300568ba-2de7-46a7-b6ae-afc625edbda1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:38.163447 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-300568ba-2de7-46a7-b6ae-afc625edbda1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:38.164176 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-300568ba-2de7-46a7-b6ae-afc625edbda1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:38.164625 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-300568ba-2de7-46a7-b6ae-afc625edbda1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:38.165039 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-300568ba-2de7-46a7-b6ae-afc625edbda1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:38.179122 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-300568ba-2de7-46a7-b6ae-afc625edbda1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] HTTP exception thrown: Instance 8ddc2614-8a62-4c61-a086-8dbab65e1f4a could not be found. Sep 01 16:40:38.180908 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-300568ba-2de7-46a7-b6ae-afc625edbda1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Request method failure captured: Sep 01 16:40:38.180908 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: request: GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a HTTP/1.1 Sep 01 16:40:38.180908 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 01 16:40:38.180908 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 01 16:40:38.180908 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Connection: close Sep 01 16:40:38.180908 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 01 16:40:38.180908 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 01 16:40:38.180908 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Host: 10.222.0.62 Sep 01 16:40:38.180908 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 01 16:40:38.180908 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 01 16:40:38.180908 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjEN-E-s7JY0G8Q_0XlNdteecvhyJOB3R9JuSnwjbBxjqSmKnH2JgnKcxdC0KzuPvp5t_LQ7zwQRhEMvZBBZ8MNeHxomRlxn5-OfP0evxTGU8VlAW00U2H4sUxAfbZgcfD8lZz_WpNN0oNf1pKt7BLJq3oPH0SkJQenihwbo4PnCvNbAw Sep 01 16:40:38.180908 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 01 16:40:38.180908 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 01 16:40:38.180908 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 01 16:40:38.180908 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 01 16:40:38.180908 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 16:40:38.180908 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 01 16:40:38.180908 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 01 16:40:38.180908 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Id: 6470f32e4a954dcab3e0ccdd2736c1f6 Sep 01 16:40:38.180908 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-257291902 Sep 01 16:40:38.180908 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 01 16:40:38.180908 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 01 16:40:38.182580 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6470f32e4a954dcab3e0ccdd2736c1f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/6470f32e4a954dcab3e0ccdd2736c1f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_6470f32e4a954dcab3e0ccdd2736c1f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6470f32e4a954dcab3e0ccdd2736c1f6"}]}] Sep 01 16:40:38.182580 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-AttachVolumeShelveTestJSON-257291902 Sep 01 16:40:38.182580 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Id: 6470f32e4a954dcab3e0ccdd2736c1f6 Sep 01 16:40:38.182580 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-257291902 Sep 01 16:40:38.182580 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User: tempest-AttachVolumeShelveTestJSON-257291902-project Sep 01 16:40:38.182580 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 01 16:40:38.182580 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 01 16:40:38.182580 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Id: 849f875ede78424c81919df6d9c152dd Sep 01 16:40:38.182580 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-AttachVolumeShelveTestJSON-257291902-project Sep 01 16:40:38.182580 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: method: > Sep 01 16:40:38.182580 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: exception: Instance 8ddc2614-8a62-4c61-a086-8dbab65e1f4a could not be found. Sep 01 16:40:38.182580 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: action_args: {'id': '8ddc2614-8a62-4c61-a086-8dbab65e1f4a'} Sep 01 16:40:38.183447 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:40:38.183447 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:38.183447 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:40:38.183447 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:40:38.183447 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:40:38.183447 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:40:38.183447 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:40:38.183447 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:40:38.183447 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:40:38.183447 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:40:38.183447 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ddc2614-8a62-4c61-a086-8dbab65e1f4a could not be found. Sep 01 16:40:38.183447 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:40:38.183447 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:40:38.183447 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:40:38.183447 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:38.183447 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:40:38.183447 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:40:38.183447 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:40:38.183447 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:40:38.183447 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:40:38.184710 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:40:38.184710 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:40:38.184710 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:40:38.184710 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:40:38.184710 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:40:38.184710 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:40:38.184710 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:40:38.184710 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ddc2614-8a62-4c61-a086-8dbab65e1f4a could not be found. Sep 01 16:40:38.184710 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:40:38.184710 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:40:38.184710 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:40:38.184710 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:38.184710 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:40:38.184710 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:40:38.184710 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:40:38.184710 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:40:38.184710 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ddc2614-8a62-4c61-a086-8dbab65e1f4a could not be found. Sep 01 16:40:38.184710 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:40:38.185795 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-300568ba-2de7-46a7-b6ae-afc625edbda1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Returning 404 to user: Instance 8ddc2614-8a62-4c61-a086-8dbab65e1f4a could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:40:38.185795 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-300568ba-2de7-46a7-b6ae-afc625edbda1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 404 len: 111 microversion: 2.20 time: 0.035204 Sep 01 16:40:38.185795 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 325/620] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:38 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 16:40:38.191953 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-fafee3db-6ae4-4e33-87c4-53abc929b6d3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '.version_select at 0x7f9482271dc0>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:38.215286 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-fafee3db-6ae4-4e33-87c4-53abc929b6d3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1021103441" status: 204 len: 0 microversion: 2.20 time: 0.026875 Sep 01 16:40:38.216267 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 296/621] 10.222.0.62 () {60 vars in 1262 bytes} [Thu Sep 1 16:40:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1021103441 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 16:40:38.796933 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-c9307065-59d4-45c3-af6a-30a0f82b83aa req-b4e4770a-0b9b-4b6b-9312-e08bf3b10754 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f85533a0-bc5b-465a-895d-a473efbb0859", "tag": "dd7294aa-e60e-425e-98a5-e2158ff841de"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:38.806311 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-c9307065-59d4-45c3-af6a-30a0f82b83aa req-b4e4770a-0b9b-4b6b-9312-e08bf3b10754 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:38.806743 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-c9307065-59d4-45c3-af6a-30a0f82b83aa req-b4e4770a-0b9b-4b6b-9312-e08bf3b10754 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:38.807385 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-c9307065-59d4-45c3-af6a-30a0f82b83aa req-b4e4770a-0b9b-4b6b-9312-e08bf3b10754 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:38.818765 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-c9307065-59d4-45c3-af6a-30a0f82b83aa req-b4e4770a-0b9b-4b6b-9312-e08bf3b10754 service nova] Creating event network-changed:dd7294aa-e60e-425e-98a5-e2158ff841de for instance f85533a0-bc5b-465a-895d-a473efbb0859 on hv-cinder-85221 Sep 01 16:40:38.823823 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-c9307065-59d4-45c3-af6a-30a0f82b83aa req-b4e4770a-0b9b-4b6b-9312-e08bf3b10754 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030711 Sep 01 16:40:38.824550 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 326/622] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:40:39.409515 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e1ab00fb-f80c-465c-b3f7-3f7e6a38893d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Action: 'create', calling method: .version_select at 0x7f948223a1f0>, body: {"keypair": {"name": "tempest-keypair-738371928", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGjPO4agFptLqhEioI/K6h3PFgoyjcIfsLu3FCe6nMbVd0H52AMMISpLS6kjXcQLTj2DsGnC/IdVNT3aNJKQrsKVcm1sVPjKatuPbBrQUIyFtC+puRt//M7/nza6RXHdQ=="}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:39.421055 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:39.429010 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-e1ab00fb-f80c-465c-b3f7-3f7e6a38893d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Getting quotas for project 6470f32e4a954dcab3e0ccdd2736c1f6. Resources: {'key_pairs'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:40:39.434049 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-e1ab00fb-f80c-465c-b3f7-3f7e6a38893d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Getting quotas for user 849f875ede78424c81919df6d9c152dd and project 6470f32e4a954dcab3e0ccdd2736c1f6. Resources: {'key_pairs'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:40:39.459240 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e1ab00fb-f80c-465c-b3f7-3f7e6a38893d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.055314 Sep 01 16:40:39.460154 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 297/623] 10.222.0.62 () {62 vars in 1200 bytes} [Thu Sep 1 16:40:39 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 57 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 01 16:40:40.992046 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c0cf8090-b734-4d05-bd80-89f721391e8a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1245934801", "imageRef": "49e5276c-002c-454f-8be8-76deb18b6b28", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "530d2089-1346-4325-99ed-e2a88eba2319"}], "security_groups": [{"name": "tempest-securitygroup--1721353510"}], "key_name": "tempest-keypair-738371928", "user_data": "}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:41.100894 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.network.neutron [None req-c0cf8090-b734-4d05-bd80-89f721391e8a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] validate_networks() for [('530d2089-1346-4325-99ed-e2a88eba2319', None, None, None, None, None)] {{(pid=127199) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:40:41.510673 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-c0cf8090-b734-4d05-bd80-89f721391e8a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Flavor limits 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:40:41.511274 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-c0cf8090-b734-4d05-bd80-89f721391e8a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Image limits 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:40:41.511961 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-c0cf8090-b734-4d05-bd80-89f721391e8a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Flavor pref 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:40:41.512519 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-c0cf8090-b734-4d05-bd80-89f721391e8a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Image pref 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:40:41.513153 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-c0cf8090-b734-4d05-bd80-89f721391e8a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:40:41.522855 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c0cf8090-b734-4d05-bd80-89f721391e8a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:41.523340 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c0cf8090-b734-4d05-bd80-89f721391e8a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:41.523772 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c0cf8090-b734-4d05-bd80-89f721391e8a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:41.524525 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c0cf8090-b734-4d05-bd80-89f721391e8a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:41.524967 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c0cf8090-b734-4d05-bd80-89f721391e8a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:41.525381 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c0cf8090-b734-4d05-bd80-89f721391e8a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:41.543322 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-c0cf8090-b734-4d05-bd80-89f721391e8a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Getting quotas for project 6470f32e4a954dcab3e0ccdd2736c1f6. Resources: {'ram', 'cores', 'instances'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:40:41.547682 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-c0cf8090-b734-4d05-bd80-89f721391e8a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Getting quotas for user 849f875ede78424c81919df6d9c152dd and project 6470f32e4a954dcab3e0ccdd2736c1f6. Resources: {'ram', 'cores', 'instances'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:40:41.559746 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-c0cf8090-b734-4d05-bd80-89f721391e8a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Going to run 1 instances... {{(pid=127199) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:40:41.562258 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-c0cf8090-b734-4d05-bd80-89f721391e8a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='49e5276c-002c-454f-8be8-76deb18b6b28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:40:41.612502 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-c0cf8090-b734-4d05-bd80-89f721391e8a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.625426 Sep 01 16:40:41.613133 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 327/624] 10.222.0.62 () {62 vars in 1188 bytes} [Thu Sep 1 16:40:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 01 16:40:41.624894 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9553446e-5a3c-4d45-9015-7d59846c5f80 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:41.625613 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9553446e-5a3c-4d45-9015-7d59846c5f80 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:41.683440 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9553446e-5a3c-4d45-9015-7d59846c5f80 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:41.691319 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9553446e-5a3c-4d45-9015-7d59846c5f80 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:41.692823 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9553446e-5a3c-4d45-9015-7d59846c5f80 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:41.693963 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9553446e-5a3c-4d45-9015-7d59846c5f80 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1281 microversion: 2.20 time: 0.073724 Sep 01 16:40:41.694526 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 298/625] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:41 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1281 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:42.717526 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-396cee1e-3550-4973-a9e9-0d30b227016d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:42.718175 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-396cee1e-3550-4973-a9e9-0d30b227016d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:42.725483 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-396cee1e-3550-4973-a9e9-0d30b227016d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:42.725939 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-396cee1e-3550-4973-a9e9-0d30b227016d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:42.726398 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-396cee1e-3550-4973-a9e9-0d30b227016d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:42.727091 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-396cee1e-3550-4973-a9e9-0d30b227016d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:42.727536 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-396cee1e-3550-4973-a9e9-0d30b227016d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:42.727967 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-396cee1e-3550-4973-a9e9-0d30b227016d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:42.802002 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-396cee1e-3550-4973-a9e9-0d30b227016d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:42.811299 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-396cee1e-3550-4973-a9e9-0d30b227016d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:42.812783 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-396cee1e-3550-4973-a9e9-0d30b227016d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:42.814274 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-396cee1e-3550-4973-a9e9-0d30b227016d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1333 microversion: 2.20 time: 0.100893 Sep 01 16:40:42.814859 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 328/626] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:42 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1333 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:43.839967 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-34beb3d7-0467-4eb4-83ce-80f8c3a72c6a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:43.840651 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-34beb3d7-0467-4eb4-83ce-80f8c3a72c6a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:43.849680 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-34beb3d7-0467-4eb4-83ce-80f8c3a72c6a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:43.850174 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-34beb3d7-0467-4eb4-83ce-80f8c3a72c6a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:43.850845 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-34beb3d7-0467-4eb4-83ce-80f8c3a72c6a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:43.851567 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-34beb3d7-0467-4eb4-83ce-80f8c3a72c6a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:43.852063 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-34beb3d7-0467-4eb4-83ce-80f8c3a72c6a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:43.852530 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-34beb3d7-0467-4eb4-83ce-80f8c3a72c6a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:44.098617 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-34beb3d7-0467-4eb4-83ce-80f8c3a72c6a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:44.107534 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-34beb3d7-0467-4eb4-83ce-80f8c3a72c6a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:44.109023 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-34beb3d7-0467-4eb4-83ce-80f8c3a72c6a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:44.111037 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-34beb3d7-0467-4eb4-83ce-80f8c3a72c6a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1407 microversion: 2.20 time: 0.274847 Sep 01 16:40:44.111675 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 299/627] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:43 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1407 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:44.409703 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-fc2f077c-3991-4df7-bcd8-39403c969e3d req-5aadb8b8-767d-4a08-9a2f-fa4c61799ff5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ae2e10f-5b22-4257-b92d-bc87e0df662b", "tag": "eff032c5-6a93-4a57-984a-8860719c6117"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:44.419806 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-fc2f077c-3991-4df7-bcd8-39403c969e3d req-5aadb8b8-767d-4a08-9a2f-fa4c61799ff5 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:44.420346 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-fc2f077c-3991-4df7-bcd8-39403c969e3d req-5aadb8b8-767d-4a08-9a2f-fa4c61799ff5 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:44.420773 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-fc2f077c-3991-4df7-bcd8-39403c969e3d req-5aadb8b8-767d-4a08-9a2f-fa4c61799ff5 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:44.432705 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-fc2f077c-3991-4df7-bcd8-39403c969e3d req-5aadb8b8-767d-4a08-9a2f-fa4c61799ff5 service nova] Creating event network-changed:eff032c5-6a93-4a57-984a-8860719c6117 for instance 0ae2e10f-5b22-4257-b92d-bc87e0df662b on hv-cinder-85221 Sep 01 16:40:44.437936 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-fc2f077c-3991-4df7-bcd8-39403c969e3d req-5aadb8b8-767d-4a08-9a2f-fa4c61799ff5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032472 Sep 01 16:40:44.438676 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 329/628] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:40:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:40:45.135459 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-77ef26aa-440b-4de7-9b4d-082945444d77 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:45.136070 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-77ef26aa-440b-4de7-9b4d-082945444d77 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:45.143351 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-77ef26aa-440b-4de7-9b4d-082945444d77 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:45.143854 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-77ef26aa-440b-4de7-9b4d-082945444d77 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:45.144339 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-77ef26aa-440b-4de7-9b4d-082945444d77 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:45.145026 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-77ef26aa-440b-4de7-9b4d-082945444d77 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:45.145479 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-77ef26aa-440b-4de7-9b4d-082945444d77 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:45.145890 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-77ef26aa-440b-4de7-9b4d-082945444d77 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:45.300847 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-77ef26aa-440b-4de7-9b4d-082945444d77 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:45.318978 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-77ef26aa-440b-4de7-9b4d-082945444d77 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:45.320587 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-77ef26aa-440b-4de7-9b4d-082945444d77 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:45.321745 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-77ef26aa-440b-4de7-9b4d-082945444d77 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1407 microversion: 2.20 time: 0.190449 Sep 01 16:40:45.322360 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 300/629] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:45 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:46.346582 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e9a8a2d6-985a-47ca-ae4d-bd3f04870170 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:46.347362 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e9a8a2d6-985a-47ca-ae4d-bd3f04870170 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:46.354041 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e9a8a2d6-985a-47ca-ae4d-bd3f04870170 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:46.354529 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e9a8a2d6-985a-47ca-ae4d-bd3f04870170 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:46.355030 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e9a8a2d6-985a-47ca-ae4d-bd3f04870170 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:46.355799 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e9a8a2d6-985a-47ca-ae4d-bd3f04870170 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:46.356372 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e9a8a2d6-985a-47ca-ae4d-bd3f04870170 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:46.356854 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e9a8a2d6-985a-47ca-ae4d-bd3f04870170 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:46.518215 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-e9a8a2d6-985a-47ca-ae4d-bd3f04870170 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:46.526820 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-e9a8a2d6-985a-47ca-ae4d-bd3f04870170 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:46.528288 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-e9a8a2d6-985a-47ca-ae4d-bd3f04870170 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:46.529420 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e9a8a2d6-985a-47ca-ae4d-bd3f04870170 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1407 microversion: 2.20 time: 0.187833 Sep 01 16:40:46.530014 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 330/630] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:46 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:47.552817 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7fe84c1d-4ba1-4caa-92d8-0d2e433bdfbd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:47.553777 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7fe84c1d-4ba1-4caa-92d8-0d2e433bdfbd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:47.560869 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7fe84c1d-4ba1-4caa-92d8-0d2e433bdfbd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:47.561357 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7fe84c1d-4ba1-4caa-92d8-0d2e433bdfbd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:47.561795 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7fe84c1d-4ba1-4caa-92d8-0d2e433bdfbd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:47.562499 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7fe84c1d-4ba1-4caa-92d8-0d2e433bdfbd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:47.562949 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7fe84c1d-4ba1-4caa-92d8-0d2e433bdfbd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:47.563796 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7fe84c1d-4ba1-4caa-92d8-0d2e433bdfbd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:47.701759 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7fe84c1d-4ba1-4caa-92d8-0d2e433bdfbd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:47.710768 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7fe84c1d-4ba1-4caa-92d8-0d2e433bdfbd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:47.712218 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7fe84c1d-4ba1-4caa-92d8-0d2e433bdfbd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:47.713293 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7fe84c1d-4ba1-4caa-92d8-0d2e433bdfbd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1407 microversion: 2.20 time: 0.164900 Sep 01 16:40:47.713884 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 301/631] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:47 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:48.736722 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-bcea4c5e-cd4c-46b0-9db8-75ae035cb8f3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:48.737473 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-bcea4c5e-cd4c-46b0-9db8-75ae035cb8f3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:48.744091 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bcea4c5e-cd4c-46b0-9db8-75ae035cb8f3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:48.744567 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bcea4c5e-cd4c-46b0-9db8-75ae035cb8f3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:48.744987 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bcea4c5e-cd4c-46b0-9db8-75ae035cb8f3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:48.745668 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bcea4c5e-cd4c-46b0-9db8-75ae035cb8f3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:48.746106 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bcea4c5e-cd4c-46b0-9db8-75ae035cb8f3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:48.746516 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bcea4c5e-cd4c-46b0-9db8-75ae035cb8f3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:48.884232 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-bcea4c5e-cd4c-46b0-9db8-75ae035cb8f3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:48.892792 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-bcea4c5e-cd4c-46b0-9db8-75ae035cb8f3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:48.894682 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-bcea4c5e-cd4c-46b0-9db8-75ae035cb8f3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:48.895853 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-bcea4c5e-cd4c-46b0-9db8-75ae035cb8f3 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1407 microversion: 2.20 time: 0.163373 Sep 01 16:40:48.896486 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 331/632] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:48 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:49.918902 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-95c66b92-349a-40f9-806c-ea78be36ab0e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:49.919490 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-95c66b92-349a-40f9-806c-ea78be36ab0e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:49.927358 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-95c66b92-349a-40f9-806c-ea78be36ab0e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:49.927882 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-95c66b92-349a-40f9-806c-ea78be36ab0e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:49.928376 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-95c66b92-349a-40f9-806c-ea78be36ab0e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:49.929077 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-95c66b92-349a-40f9-806c-ea78be36ab0e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:49.929512 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-95c66b92-349a-40f9-806c-ea78be36ab0e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:49.929930 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-95c66b92-349a-40f9-806c-ea78be36ab0e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:50.021666 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-d21cf032-d052-4c95-b08a-e961d213b011 req-d140e9d0-ee10-45ab-843a-ff19b5670913 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ae2e10f-5b22-4257-b92d-bc87e0df662b", "name": "network-vif-plugged", "status": "completed", "tag": "eff032c5-6a93-4a57-984a-8860719c6117"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:50.033443 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-d21cf032-d052-4c95-b08a-e961d213b011 req-d140e9d0-ee10-45ab-843a-ff19b5670913 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:50.034003 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-d21cf032-d052-4c95-b08a-e961d213b011 req-d140e9d0-ee10-45ab-843a-ff19b5670913 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:50.034874 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-d21cf032-d052-4c95-b08a-e961d213b011 req-d140e9d0-ee10-45ab-843a-ff19b5670913 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:50.040217 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:50.051990 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-d21cf032-d052-4c95-b08a-e961d213b011 req-d140e9d0-ee10-45ab-843a-ff19b5670913 service nova] Creating event network-vif-plugged:eff032c5-6a93-4a57-984a-8860719c6117 for instance 0ae2e10f-5b22-4257-b92d-bc87e0df662b on hv-cinder-85221 Sep 01 16:40:50.058079 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-d21cf032-d052-4c95-b08a-e961d213b011 req-d140e9d0-ee10-45ab-843a-ff19b5670913 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040308 Sep 01 16:40:50.059266 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 332/633] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:40:50.070244 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-95c66b92-349a-40f9-806c-ea78be36ab0e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:50.079502 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-95c66b92-349a-40f9-806c-ea78be36ab0e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:50.080989 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-95c66b92-349a-40f9-806c-ea78be36ab0e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:50.082393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-95c66b92-349a-40f9-806c-ea78be36ab0e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1407 microversion: 2.20 time: 0.167485 Sep 01 16:40:50.082979 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 302/634] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:49 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:51.107065 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8f1cdcc4-75d4-4386-acd4-9e94b903144f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:51.107759 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-8f1cdcc4-75d4-4386-acd4-9e94b903144f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:51.110127 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:51.116325 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8f1cdcc4-75d4-4386-acd4-9e94b903144f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:51.116809 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8f1cdcc4-75d4-4386-acd4-9e94b903144f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:51.117223 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8f1cdcc4-75d4-4386-acd4-9e94b903144f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:51.117914 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8f1cdcc4-75d4-4386-acd4-9e94b903144f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:51.118346 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8f1cdcc4-75d4-4386-acd4-9e94b903144f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:51.118773 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8f1cdcc4-75d4-4386-acd4-9e94b903144f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:51.272061 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8f1cdcc4-75d4-4386-acd4-9e94b903144f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:51.280929 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8f1cdcc4-75d4-4386-acd4-9e94b903144f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:51.282373 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8f1cdcc4-75d4-4386-acd4-9e94b903144f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:51.283488 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8f1cdcc4-75d4-4386-acd4-9e94b903144f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1407 microversion: 2.20 time: 0.180839 Sep 01 16:40:51.284078 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 333/635] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:51 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:52.307469 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1918d19f-e169-479e-95b2-6ab582edb116 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:52.308100 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1918d19f-e169-479e-95b2-6ab582edb116 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:52.310501 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=6 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:52.316432 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1918d19f-e169-479e-95b2-6ab582edb116 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:52.316915 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1918d19f-e169-479e-95b2-6ab582edb116 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:52.317378 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1918d19f-e169-479e-95b2-6ab582edb116 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:52.318075 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1918d19f-e169-479e-95b2-6ab582edb116 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:52.318554 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1918d19f-e169-479e-95b2-6ab582edb116 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:52.318973 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1918d19f-e169-479e-95b2-6ab582edb116 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:52.474838 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1918d19f-e169-479e-95b2-6ab582edb116 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:52.484952 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1918d19f-e169-479e-95b2-6ab582edb116 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:52.486410 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1918d19f-e169-479e-95b2-6ab582edb116 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:52.487525 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1918d19f-e169-479e-95b2-6ab582edb116 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1407 microversion: 2.20 time: 0.184048 Sep 01 16:40:52.488106 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 303/636] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:52 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:53.512198 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-5b5f5b3c-c6de-4243-993a-b7fae99c8c45 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:53.512766 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-5b5f5b3c-c6de-4243-993a-b7fae99c8c45 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:53.514608 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=2 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:53.515254 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=6 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:53.520977 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5b5f5b3c-c6de-4243-993a-b7fae99c8c45 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:53.521482 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5b5f5b3c-c6de-4243-993a-b7fae99c8c45 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:53.521995 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5b5f5b3c-c6de-4243-993a-b7fae99c8c45 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:53.522714 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5b5f5b3c-c6de-4243-993a-b7fae99c8c45 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:53.523174 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5b5f5b3c-c6de-4243-993a-b7fae99c8c45 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:53.523619 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5b5f5b3c-c6de-4243-993a-b7fae99c8c45 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:53.666536 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-5b5f5b3c-c6de-4243-993a-b7fae99c8c45 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:53.674867 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-5b5f5b3c-c6de-4243-993a-b7fae99c8c45 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:53.676337 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-5b5f5b3c-c6de-4243-993a-b7fae99c8c45 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:53.677495 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-5b5f5b3c-c6de-4243-993a-b7fae99c8c45 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1599 microversion: 2.20 time: 0.169575 Sep 01 16:40:53.678210 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 334/637] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:53 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1599 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:53.701339 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2825d3fc-d591-4d64-9a1c-bbbc0946b2f8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:53.701892 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-2825d3fc-d591-4d64-9a1c-bbbc0946b2f8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:53.708714 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2825d3fc-d591-4d64-9a1c-bbbc0946b2f8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:53.709385 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2825d3fc-d591-4d64-9a1c-bbbc0946b2f8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:53.709697 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2825d3fc-d591-4d64-9a1c-bbbc0946b2f8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:53.710555 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2825d3fc-d591-4d64-9a1c-bbbc0946b2f8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:53.710929 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2825d3fc-d591-4d64-9a1c-bbbc0946b2f8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:53.711347 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2825d3fc-d591-4d64-9a1c-bbbc0946b2f8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:53.791468 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2825d3fc-d591-4d64-9a1c-bbbc0946b2f8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.094549 Sep 01 16:40:53.792110 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 304/638] 10.222.0.62 () {60 vars in 1316 bytes} [Thu Sep 1 16:40:53 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:40:54.794947 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-78985e05-adb7-4344-8755-b0890ec076ff req-c4d0ff2c-c1a5-4e75-801f-7745833655ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ae2e10f-5b22-4257-b92d-bc87e0df662b", "tag": "eff032c5-6a93-4a57-984a-8860719c6117"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:54.805242 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-78985e05-adb7-4344-8755-b0890ec076ff req-c4d0ff2c-c1a5-4e75-801f-7745833655ae service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:54.805753 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-78985e05-adb7-4344-8755-b0890ec076ff req-c4d0ff2c-c1a5-4e75-801f-7745833655ae service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:54.806407 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-78985e05-adb7-4344-8755-b0890ec076ff req-c4d0ff2c-c1a5-4e75-801f-7745833655ae service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:54.817701 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-78985e05-adb7-4344-8755-b0890ec076ff req-c4d0ff2c-c1a5-4e75-801f-7745833655ae service nova] Creating event network-changed:eff032c5-6a93-4a57-984a-8860719c6117 for instance 0ae2e10f-5b22-4257-b92d-bc87e0df662b on hv-cinder-85221 Sep 01 16:40:54.823320 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-78985e05-adb7-4344-8755-b0890ec076ff req-c4d0ff2c-c1a5-4e75-801f-7745833655ae service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032238 Sep 01 16:40:54.823961 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 335/639] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:40:55.394145 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-86759484-b35f-45cc-a500-bd046e138b8d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:55.396652 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-86759484-b35f-45cc-a500-bd046e138b8d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:55.404731 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-86759484-b35f-45cc-a500-bd046e138b8d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:55.405199 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-86759484-b35f-45cc-a500-bd046e138b8d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:55.405732 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-86759484-b35f-45cc-a500-bd046e138b8d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:55.406441 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-86759484-b35f-45cc-a500-bd046e138b8d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:55.406895 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-86759484-b35f-45cc-a500-bd046e138b8d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:55.407315 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-86759484-b35f-45cc-a500-bd046e138b8d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:55.438402 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-86759484-b35f-45cc-a500-bd046e138b8d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048113 Sep 01 16:40:55.438981 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 305/640] 10.222.0.62 () {58 vars in 1302 bytes} [Thu Sep 1 16:40:55 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 16:40:55.501179 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-9aee526f-5e34-433d-b214-b74e8def4ed1 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:55.501760 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-9aee526f-5e34-433d-b214-b74e8def4ed1 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:55.508525 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9aee526f-5e34-433d-b214-b74e8def4ed1 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:55.509045 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9aee526f-5e34-433d-b214-b74e8def4ed1 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:55.509478 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9aee526f-5e34-433d-b214-b74e8def4ed1 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:55.510274 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9aee526f-5e34-433d-b214-b74e8def4ed1 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:55.511037 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9aee526f-5e34-433d-b214-b74e8def4ed1 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:55.511463 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9aee526f-5e34-433d-b214-b74e8def4ed1 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:55.541620 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-9aee526f-5e34-433d-b214-b74e8def4ed1 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Going to try to terminate instance {{(pid=127199) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:40:55.629437 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-9aee526f-5e34-433d-b214-b74e8def4ed1 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 204 len: 0 microversion: 2.1 time: 0.131894 Sep 01 16:40:55.630498 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 336/641] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Sep 1 16:40:55 2022] DELETE /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:40:55.639521 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-69433960-fa8e-4b62-90b4-34f91d94a264 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:55.640152 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-69433960-fa8e-4b62-90b4-34f91d94a264 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:55.646437 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-69433960-fa8e-4b62-90b4-34f91d94a264 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:55.647499 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-69433960-fa8e-4b62-90b4-34f91d94a264 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:55.647960 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-69433960-fa8e-4b62-90b4-34f91d94a264 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:55.648677 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-69433960-fa8e-4b62-90b4-34f91d94a264 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:55.649133 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-69433960-fa8e-4b62-90b4-34f91d94a264 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:55.649552 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-69433960-fa8e-4b62-90b4-34f91d94a264 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:55.665488 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=100 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:55.795552 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-69433960-fa8e-4b62-90b4-34f91d94a264 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:55.803419 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-69433960-fa8e-4b62-90b4-34f91d94a264 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1672 microversion: 2.1 time: 0.167786 Sep 01 16:40:55.804004 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 306/642] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:55 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1672 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:56.828924 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-1b094294-105e-4371-8a81-2d1cb84e7be2 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:56.829875 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-1b094294-105e-4371-8a81-2d1cb84e7be2 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:56.837794 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1b094294-105e-4371-8a81-2d1cb84e7be2 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:56.838285 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1b094294-105e-4371-8a81-2d1cb84e7be2 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:56.838713 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1b094294-105e-4371-8a81-2d1cb84e7be2 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:56.839415 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1b094294-105e-4371-8a81-2d1cb84e7be2 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:56.839856 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1b094294-105e-4371-8a81-2d1cb84e7be2 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:56.840303 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1b094294-105e-4371-8a81-2d1cb84e7be2 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:57.009434 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-1b094294-105e-4371-8a81-2d1cb84e7be2 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:57.017665 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-1b094294-105e-4371-8a81-2d1cb84e7be2 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1672 microversion: 2.1 time: 0.196086 Sep 01 16:40:57.018238 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 337/643] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:56 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1672 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:58.039309 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-38fc7539-0de0-487e-8ac0-1388b2b13645 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:58.040079 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-38fc7539-0de0-487e-8ac0-1388b2b13645 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:58.046959 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-38fc7539-0de0-487e-8ac0-1388b2b13645 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:58.047528 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-38fc7539-0de0-487e-8ac0-1388b2b13645 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:58.048101 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-38fc7539-0de0-487e-8ac0-1388b2b13645 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:58.048869 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-38fc7539-0de0-487e-8ac0-1388b2b13645 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:58.049331 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-38fc7539-0de0-487e-8ac0-1388b2b13645 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:58.049756 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-38fc7539-0de0-487e-8ac0-1388b2b13645 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:58.289884 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-38fc7539-0de0-487e-8ac0-1388b2b13645 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:58.298640 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-38fc7539-0de0-487e-8ac0-1388b2b13645 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1672 microversion: 2.1 time: 0.263589 Sep 01 16:40:58.299489 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 307/644] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:58 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1672 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:58.880476 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-3d5364f4-1153-4d51-b640-29d188f8a7d8 req-5614b198-7ebc-4231-81c5-d42c47d96ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1bf96dd-b79a-403b-aa81-985c692df037", "name": "network-vif-deleted", "tag": "89467631-d9b5-466b-89fd-219067a07f3e"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:58.890464 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-3d5364f4-1153-4d51-b640-29d188f8a7d8 req-5614b198-7ebc-4231-81c5-d42c47d96ab3 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:58.890928 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-3d5364f4-1153-4d51-b640-29d188f8a7d8 req-5614b198-7ebc-4231-81c5-d42c47d96ab3 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:58.891439 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-3d5364f4-1153-4d51-b640-29d188f8a7d8 req-5614b198-7ebc-4231-81c5-d42c47d96ab3 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:58.914227 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-3d5364f4-1153-4d51-b640-29d188f8a7d8 req-5614b198-7ebc-4231-81c5-d42c47d96ab3 service nova] Creating event network-vif-deleted:89467631-d9b5-466b-89fd-219067a07f3e for instance a1bf96dd-b79a-403b-aa81-985c692df037 on hv-cinder-85221 Sep 01 16:40:58.920083 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-3d5364f4-1153-4d51-b640-29d188f8a7d8 req-5614b198-7ebc-4231-81c5-d42c47d96ab3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043152 Sep 01 16:40:58.921039 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 338/645] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:40:59.322472 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-cdc4ace8-2423-4ef8-9b6b-ef88652a3b76 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:59.323084 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-cdc4ace8-2423-4ef8-9b6b-ef88652a3b76 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:59.330286 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cdc4ace8-2423-4ef8-9b6b-ef88652a3b76 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:59.330816 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cdc4ace8-2423-4ef8-9b6b-ef88652a3b76 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:59.331236 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cdc4ace8-2423-4ef8-9b6b-ef88652a3b76 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:59.331934 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cdc4ace8-2423-4ef8-9b6b-ef88652a3b76 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:59.332424 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cdc4ace8-2423-4ef8-9b6b-ef88652a3b76 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:59.332853 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cdc4ace8-2423-4ef8-9b6b-ef88652a3b76 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:59.365873 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cdc4ace8-2423-4ef8-9b6b-ef88652a3b76 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:59.366359 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cdc4ace8-2423-4ef8-9b6b-ef88652a3b76 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:59.366790 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cdc4ace8-2423-4ef8-9b6b-ef88652a3b76 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:59.367255 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-cdc4ace8-2423-4ef8-9b6b-ef88652a3b76 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lazy-loading 'fault' on Instance uuid a1bf96dd-b79a-403b-aa81-985c692df037 {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:40:59.413387 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-cdc4ace8-2423-4ef8-9b6b-ef88652a3b76 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:59.421555 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-cdc4ace8-2423-4ef8-9b6b-ef88652a3b76 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 200 len: 1326 microversion: 2.1 time: 0.103141 Sep 01 16:40:59.422037 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 308/646] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:59 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 1326 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:00.445471 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-1bdf2a70-7f1d-449a-9ef1-a599a4ea4d16 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:00.446163 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-1bdf2a70-7f1d-449a-9ef1-a599a4ea4d16 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:00.453330 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1bdf2a70-7f1d-449a-9ef1-a599a4ea4d16 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:00.453812 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1bdf2a70-7f1d-449a-9ef1-a599a4ea4d16 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:00.454233 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1bdf2a70-7f1d-449a-9ef1-a599a4ea4d16 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:00.454933 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1bdf2a70-7f1d-449a-9ef1-a599a4ea4d16 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:00.455372 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1bdf2a70-7f1d-449a-9ef1-a599a4ea4d16 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:00.455782 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1bdf2a70-7f1d-449a-9ef1-a599a4ea4d16 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:00.469443 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-1bdf2a70-7f1d-449a-9ef1-a599a4ea4d16 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] HTTP exception thrown: Instance a1bf96dd-b79a-403b-aa81-985c692df037 could not be found. Sep 01 16:41:00.471066 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-1bdf2a70-7f1d-449a-9ef1-a599a4ea4d16 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Request method failure captured: Sep 01 16:41:00.471066 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: request: GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 HTTP/1.1 Sep 01 16:41:00.471066 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 01 16:41:00.471066 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 01 16:41:00.471066 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Connection: close Sep 01 16:41:00.471066 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 01 16:41:00.471066 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 01 16:41:00.471066 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Host: 10.222.0.62 Sep 01 16:41:00.471066 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 01 16:41:00.471066 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 01 16:41:00.471066 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjEN-K2rHO5_6mEnKeD6mym-6cImk-4p7IPqzSyInBRSOPCBmISrGJrS_5QzYpTocaV_mMwLwQVawcfbXpZhhqNsVfiWomgC95jI-4zuabKHIyiZRHL4hHml7yhd0haaFIfMKUTx3oGMWDfNuCY-ZQIqb2HF_tuMUs4l2bPvDV6iovGYI Sep 01 16:41:00.471066 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 01 16:41:00.471066 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 01 16:41:00.471066 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 01 16:41:00.471066 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 01 16:41:00.471066 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 01 16:41:00.471066 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 01 16:41:00.471066 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Id: af2ea34aea99498eb36647be71aec5e8 Sep 01 16:41:00.471066 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-AttachVolumeTestJSON-471958966 Sep 01 16:41:00.471066 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 01 16:41:00.471066 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 01 16:41:00.473013 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/af2ea34aea99498eb36647be71aec5e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/af2ea34aea99498eb36647be71aec5e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_af2ea34aea99498eb36647be71aec5e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/af2ea34aea99498eb36647be71aec5e8"}]}] Sep 01 16:41:00.473013 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-AttachVolumeTestJSON-471958966 Sep 01 16:41:00.473013 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Id: af2ea34aea99498eb36647be71aec5e8 Sep 01 16:41:00.473013 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-AttachVolumeTestJSON-471958966 Sep 01 16:41:00.473013 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User: tempest-AttachVolumeTestJSON-471958966-project Sep 01 16:41:00.473013 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 01 16:41:00.473013 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 01 16:41:00.473013 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Id: 2c1c3f8f28b147fc838533baf62b72af Sep 01 16:41:00.473013 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-AttachVolumeTestJSON-471958966-project Sep 01 16:41:00.473013 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: method: > Sep 01 16:41:00.473013 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: exception: Instance a1bf96dd-b79a-403b-aa81-985c692df037 could not be found. Sep 01 16:41:00.473013 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: action_args: {'id': 'a1bf96dd-b79a-403b-aa81-985c692df037'} Sep 01 16:41:00.474367 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:41:00.474367 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:00.474367 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:41:00.474367 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:41:00.474367 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:41:00.474367 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:41:00.474367 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:41:00.474367 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:41:00.474367 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:41:00.474367 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:41:00.474367 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1bf96dd-b79a-403b-aa81-985c692df037 could not be found. Sep 01 16:41:00.474367 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:00.474367 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:00.474367 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:00.474367 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:00.474367 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:00.474367 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:00.474367 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:41:00.474367 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:41:00.474367 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:41:00.475795 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:41:00.475795 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:41:00.475795 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:41:00.475795 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:41:00.475795 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:41:00.475795 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:41:00.475795 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:41:00.475795 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1bf96dd-b79a-403b-aa81-985c692df037 could not be found. Sep 01 16:41:00.475795 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:00.475795 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:00.475795 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:00.475795 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:00.475795 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:00.475795 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:00.475795 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:41:00.475795 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:41:00.475795 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1bf96dd-b79a-403b-aa81-985c692df037 could not be found. Sep 01 16:41:00.475795 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:00.477737 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-1bdf2a70-7f1d-449a-9ef1-a599a4ea4d16 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Returning 404 to user: Instance a1bf96dd-b79a-403b-aa81-985c692df037 could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:41:00.477737 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-1bdf2a70-7f1d-449a-9ef1-a599a4ea4d16 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 404 len: 111 microversion: 2.1 time: 0.031520 Sep 01 16:41:00.477737 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 339/647] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:00 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:41:00.489669 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f577b715-f855-4c2e-82be-2a7322dc316e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '.version_select at 0x7f9482445f70>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:00.518424 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f577b715-f855-4c2e-82be-2a7322dc316e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1519976901" status: 202 len: 0 microversion: 2.1 time: 0.038212 Sep 01 16:41:00.519054 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 309/648] 10.222.0.62 () {58 vars in 1221 bytes} [Thu Sep 1 16:41:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1519976901 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:41:01.184675 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c5c2b4da-5125-4c87-a69a-c6922b2af371 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Action: 'create', calling method: .version_select at 0x7f9482621940>, body: {"keypair": {"name": "tempest-keypair-67985811", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLV2nCdhGPcb01Y/gPGD+gFWD+VOKu0As0fWy0njeqygtPtTNvIXz+nwODWfl/IeZCiaqKVASL5xoPa9tE2Z3eqBZuMwpvGmX8Q/nrXtApgYeCEJiiOqcZ/6fcywx67Yew=="}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:01.201572 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-c5c2b4da-5125-4c87-a69a-c6922b2af371 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Getting quotas for project af2ea34aea99498eb36647be71aec5e8. Resources: {'key_pairs'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:41:01.205592 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-c5c2b4da-5125-4c87-a69a-c6922b2af371 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Getting quotas for user 2c1c3f8f28b147fc838533baf62b72af and project af2ea34aea99498eb36647be71aec5e8. Resources: {'key_pairs'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:41:01.231431 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-c5c2b4da-5125-4c87-a69a-c6922b2af371 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.050961 Sep 01 16:41:01.232054 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 340/649] 10.222.0.62 () {60 vars in 1159 bytes} [Thu Sep 1 16:41:01 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:02.548351 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-40312b8a-3a2a-4029-90b1-52a748f17b89 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-474258800", "imageRef": "49e5276c-002c-454f-8be8-76deb18b6b28", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8b128f9b-7054-469d-ab8b-4c59b78f775a"}], "security_groups": [{"name": "tempest-securitygroup--1739176153"}], "key_name": "tempest-keypair-67985811", "user_data": "}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:02.664291 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.network.neutron [None req-40312b8a-3a2a-4029-90b1-52a748f17b89 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] validate_networks() for [('8b128f9b-7054-469d-ab8b-4c59b78f775a', None, None, None, None, None)] {{(pid=127198) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:41:03.074113 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-40312b8a-3a2a-4029-90b1-52a748f17b89 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Flavor limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:41:03.074857 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-40312b8a-3a2a-4029-90b1-52a748f17b89 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Image limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:41:03.075318 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-40312b8a-3a2a-4029-90b1-52a748f17b89 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Flavor pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:41:03.075722 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-40312b8a-3a2a-4029-90b1-52a748f17b89 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Image pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:41:03.076157 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-40312b8a-3a2a-4029-90b1-52a748f17b89 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:41:03.085783 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-40312b8a-3a2a-4029-90b1-52a748f17b89 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:03.086261 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-40312b8a-3a2a-4029-90b1-52a748f17b89 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:03.086690 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-40312b8a-3a2a-4029-90b1-52a748f17b89 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:03.087380 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-40312b8a-3a2a-4029-90b1-52a748f17b89 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:03.087849 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-40312b8a-3a2a-4029-90b1-52a748f17b89 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:03.088267 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-40312b8a-3a2a-4029-90b1-52a748f17b89 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:03.105417 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-40312b8a-3a2a-4029-90b1-52a748f17b89 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Getting quotas for project af2ea34aea99498eb36647be71aec5e8. Resources: {'ram', 'cores', 'instances'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:41:03.109444 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-40312b8a-3a2a-4029-90b1-52a748f17b89 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Getting quotas for user 2c1c3f8f28b147fc838533baf62b72af and project af2ea34aea99498eb36647be71aec5e8. Resources: {'ram', 'cores', 'instances'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:41:03.120756 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-40312b8a-3a2a-4029-90b1-52a748f17b89 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Going to run 1 instances... {{(pid=127198) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:41:03.123085 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-40312b8a-3a2a-4029-90b1-52a748f17b89 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: e5e54e2a-0163-484c-9976-1a90a8fd17b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='49e5276c-002c-454f-8be8-76deb18b6b28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:41:03.175158 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-40312b8a-3a2a-4029-90b1-52a748f17b89 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.634802 Sep 01 16:41:03.175801 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 310/650] 10.222.0.62 () {60 vars in 1147 bytes} [Thu Sep 1 16:41:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:41:03.187182 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c482153d-7fa3-47b7-ac8d-ab2a86a980aa tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:03.188132 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-c482153d-7fa3-47b7-ac8d-ab2a86a980aa tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: e5e54e2a-0163-484c-9976-1a90a8fd17b9] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:03.248682 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c482153d-7fa3-47b7-ac8d-ab2a86a980aa tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:03.256410 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-c482153d-7fa3-47b7-ac8d-ab2a86a980aa tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9" status: 200 len: 1235 microversion: 2.1 time: 0.073312 Sep 01 16:41:03.256970 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 341/651] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:03 2022] GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9 => generated 1235 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:04.278110 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3dc8442c-98a1-45e1-9377-a591fb802eeb tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:04.278677 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-3dc8442c-98a1-45e1-9377-a591fb802eeb tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: e5e54e2a-0163-484c-9976-1a90a8fd17b9] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:04.285912 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3dc8442c-98a1-45e1-9377-a591fb802eeb tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:04.286399 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3dc8442c-98a1-45e1-9377-a591fb802eeb tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:04.286840 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3dc8442c-98a1-45e1-9377-a591fb802eeb tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:04.287533 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3dc8442c-98a1-45e1-9377-a591fb802eeb tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:04.288030 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3dc8442c-98a1-45e1-9377-a591fb802eeb tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:04.288458 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3dc8442c-98a1-45e1-9377-a591fb802eeb tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:04.361861 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3dc8442c-98a1-45e1-9377-a591fb802eeb tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:04.369869 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3dc8442c-98a1-45e1-9377-a591fb802eeb tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9" status: 200 len: 1287 microversion: 2.1 time: 0.095723 Sep 01 16:41:04.370479 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 311/652] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:04 2022] GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9 => generated 1287 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:05.393157 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a5999755-b289-4fc7-8f90-60a404263b36 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:05.394377 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-a5999755-b289-4fc7-8f90-60a404263b36 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: e5e54e2a-0163-484c-9976-1a90a8fd17b9] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:05.401044 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a5999755-b289-4fc7-8f90-60a404263b36 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:05.402333 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a5999755-b289-4fc7-8f90-60a404263b36 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:05.403062 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a5999755-b289-4fc7-8f90-60a404263b36 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:05.404027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a5999755-b289-4fc7-8f90-60a404263b36 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:05.404481 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a5999755-b289-4fc7-8f90-60a404263b36 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:05.404905 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a5999755-b289-4fc7-8f90-60a404263b36 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:05.943577 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-a5999755-b289-4fc7-8f90-60a404263b36 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:05.952493 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-a5999755-b289-4fc7-8f90-60a404263b36 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9" status: 200 len: 1361 microversion: 2.1 time: 0.564976 Sep 01 16:41:05.953066 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 342/653] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:05 2022] GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9 => generated 1361 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:06.346505 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-e21fd675-b78d-423e-999e-9146a33c5fa8 req-d04d4e70-4d80-401d-9b23-2613b96c2be9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5e54e2a-0163-484c-9976-1a90a8fd17b9", "tag": "b208a6b2-98cf-49b5-a8db-4c367884ea7b"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:06.360212 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-e21fd675-b78d-423e-999e-9146a33c5fa8 req-d04d4e70-4d80-401d-9b23-2613b96c2be9 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:06.360658 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-e21fd675-b78d-423e-999e-9146a33c5fa8 req-d04d4e70-4d80-401d-9b23-2613b96c2be9 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:06.361355 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-e21fd675-b78d-423e-999e-9146a33c5fa8 req-d04d4e70-4d80-401d-9b23-2613b96c2be9 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:06.374100 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-e21fd675-b78d-423e-999e-9146a33c5fa8 req-d04d4e70-4d80-401d-9b23-2613b96c2be9 service nova] Creating event network-changed:b208a6b2-98cf-49b5-a8db-4c367884ea7b for instance e5e54e2a-0163-484c-9976-1a90a8fd17b9 on hv-cinder-85221 Sep 01 16:41:06.379001 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-e21fd675-b78d-423e-999e-9146a33c5fa8 req-d04d4e70-4d80-401d-9b23-2613b96c2be9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036511 Sep 01 16:41:06.379596 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 312/654] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:06.975280 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7edd4782-1e8f-426e-906b-c12a40904ed1 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:06.975837 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-7edd4782-1e8f-426e-906b-c12a40904ed1 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: e5e54e2a-0163-484c-9976-1a90a8fd17b9] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:06.980568 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6e47562f-b0a9-4e02-a9a7-10e0e1bd2538 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:06.981135 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-6e47562f-b0a9-4e02-a9a7-10e0e1bd2538 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:06.982593 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7edd4782-1e8f-426e-906b-c12a40904ed1 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:06.983076 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7edd4782-1e8f-426e-906b-c12a40904ed1 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:06.983504 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7edd4782-1e8f-426e-906b-c12a40904ed1 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:06.984229 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7edd4782-1e8f-426e-906b-c12a40904ed1 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:06.984670 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7edd4782-1e8f-426e-906b-c12a40904ed1 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:06.985085 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7edd4782-1e8f-426e-906b-c12a40904ed1 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:06.987282 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6e47562f-b0a9-4e02-a9a7-10e0e1bd2538 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:06.987767 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6e47562f-b0a9-4e02-a9a7-10e0e1bd2538 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:06.988223 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6e47562f-b0a9-4e02-a9a7-10e0e1bd2538 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:06.988911 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6e47562f-b0a9-4e02-a9a7-10e0e1bd2538 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:06.989363 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6e47562f-b0a9-4e02-a9a7-10e0e1bd2538 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:06.989779 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6e47562f-b0a9-4e02-a9a7-10e0e1bd2538 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:07.012544 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-6e47562f-b0a9-4e02-a9a7-10e0e1bd2538 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lazy-loading 'flavor' on Instance uuid ca59565d-e140-4bf0-9ef3-9cc18f4d3068 {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:41:07.094663 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-6e47562f-b0a9-4e02-a9a7-10e0e1bd2538 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "POST /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068/action" status: 202 len: 0 microversion: 2.1 time: 0.118251 Sep 01 16:41:07.095288 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 313/655] 10.222.0.62 () {60 vars in 1278 bytes} [Thu Sep 1 16:41:06 2022] POST /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:41:07.106581 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-cef2c03c-57b5-4d11-9aca-ce9b34f41117 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:07.107276 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-cef2c03c-57b5-4d11-9aca-ce9b34f41117 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:07.113878 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cef2c03c-57b5-4d11-9aca-ce9b34f41117 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:07.114332 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cef2c03c-57b5-4d11-9aca-ce9b34f41117 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:07.114763 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cef2c03c-57b5-4d11-9aca-ce9b34f41117 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:07.115449 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cef2c03c-57b5-4d11-9aca-ce9b34f41117 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:07.115913 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cef2c03c-57b5-4d11-9aca-ce9b34f41117 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:07.116342 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cef2c03c-57b5-4d11-9aca-ce9b34f41117 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:07.134747 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-7edd4782-1e8f-426e-906b-c12a40904ed1 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:07.142879 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-7edd4782-1e8f-426e-906b-c12a40904ed1 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9" status: 200 len: 1361 microversion: 2.1 time: 0.172505 Sep 01 16:41:07.144407 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 343/656] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:06 2022] GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9 => generated 1361 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:07.255793 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-cef2c03c-57b5-4d11-9aca-ce9b34f41117 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:07.264049 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-cef2c03c-57b5-4d11-9aca-ce9b34f41117 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1568 microversion: 2.1 time: 0.163399 Sep 01 16:41:07.264631 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 314/657] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:07 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:41:08.168488 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-9dd94130-0b10-4375-8531-7d0e71ce8e71 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:08.169065 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-9dd94130-0b10-4375-8531-7d0e71ce8e71 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: e5e54e2a-0163-484c-9976-1a90a8fd17b9] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:08.175084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9dd94130-0b10-4375-8531-7d0e71ce8e71 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:08.175563 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9dd94130-0b10-4375-8531-7d0e71ce8e71 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:08.176043 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9dd94130-0b10-4375-8531-7d0e71ce8e71 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:08.176727 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9dd94130-0b10-4375-8531-7d0e71ce8e71 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:08.177167 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9dd94130-0b10-4375-8531-7d0e71ce8e71 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:08.177574 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9dd94130-0b10-4375-8531-7d0e71ce8e71 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:08.285920 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-32b92ca4-f1d6-41c9-8e96-f27dd764ff38 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:08.286581 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-32b92ca4-f1d6-41c9-8e96-f27dd764ff38 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:08.294787 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-32b92ca4-f1d6-41c9-8e96-f27dd764ff38 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:08.295275 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-32b92ca4-f1d6-41c9-8e96-f27dd764ff38 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:08.295703 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-32b92ca4-f1d6-41c9-8e96-f27dd764ff38 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:08.296435 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-32b92ca4-f1d6-41c9-8e96-f27dd764ff38 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:08.296885 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-32b92ca4-f1d6-41c9-8e96-f27dd764ff38 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:08.297349 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-32b92ca4-f1d6-41c9-8e96-f27dd764ff38 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:08.421006 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-9dd94130-0b10-4375-8531-7d0e71ce8e71 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:08.429644 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-9dd94130-0b10-4375-8531-7d0e71ce8e71 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9" status: 200 len: 1361 microversion: 2.1 time: 0.267360 Sep 01 16:41:08.430289 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 344/658] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:08 2022] GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9 => generated 1361 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:08.545433 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-32b92ca4-f1d6-41c9-8e96-f27dd764ff38 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:08.553985 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-32b92ca4-f1d6-41c9-8e96-f27dd764ff38 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1568 microversion: 2.1 time: 0.271933 Sep 01 16:41:08.554739 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 315/659] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:08 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1568 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:09.458675 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b59b950d-83a1-4332-9940-ef6b880fee82 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:09.459313 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-b59b950d-83a1-4332-9940-ef6b880fee82 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: e5e54e2a-0163-484c-9976-1a90a8fd17b9] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:09.466343 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b59b950d-83a1-4332-9940-ef6b880fee82 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:09.466919 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b59b950d-83a1-4332-9940-ef6b880fee82 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:09.467408 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b59b950d-83a1-4332-9940-ef6b880fee82 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:09.468186 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b59b950d-83a1-4332-9940-ef6b880fee82 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:09.468745 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b59b950d-83a1-4332-9940-ef6b880fee82 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:09.469216 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b59b950d-83a1-4332-9940-ef6b880fee82 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:09.575679 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9d67a44a-166e-4c20-8ca1-fdc8e2e4ee31 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:09.576869 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9d67a44a-166e-4c20-8ca1-fdc8e2e4ee31 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:09.579853 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:09.585485 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9d67a44a-166e-4c20-8ca1-fdc8e2e4ee31 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:09.585972 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9d67a44a-166e-4c20-8ca1-fdc8e2e4ee31 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:09.586402 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9d67a44a-166e-4c20-8ca1-fdc8e2e4ee31 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:09.587349 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9d67a44a-166e-4c20-8ca1-fdc8e2e4ee31 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:09.588025 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9d67a44a-166e-4c20-8ca1-fdc8e2e4ee31 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:09.588481 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9d67a44a-166e-4c20-8ca1-fdc8e2e4ee31 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:09.624155 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b59b950d-83a1-4332-9940-ef6b880fee82 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:09.632754 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-b59b950d-83a1-4332-9940-ef6b880fee82 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9" status: 200 len: 1361 microversion: 2.1 time: 0.186231 Sep 01 16:41:09.633319 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 345/660] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:09 2022] GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9 => generated 1361 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:09.926382 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9d67a44a-166e-4c20-8ca1-fdc8e2e4ee31 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:09.936399 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9d67a44a-166e-4c20-8ca1-fdc8e2e4ee31 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1568 microversion: 2.1 time: 0.364557 Sep 01 16:41:09.936969 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 316/661] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:09 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1568 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:10.656818 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8edea4df-1118-4ab5-bfd5-bd96e3d5f15d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:10.657412 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-8edea4df-1118-4ab5-bfd5-bd96e3d5f15d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: e5e54e2a-0163-484c-9976-1a90a8fd17b9] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:10.664941 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8edea4df-1118-4ab5-bfd5-bd96e3d5f15d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:10.665466 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8edea4df-1118-4ab5-bfd5-bd96e3d5f15d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:10.665930 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8edea4df-1118-4ab5-bfd5-bd96e3d5f15d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:10.666615 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8edea4df-1118-4ab5-bfd5-bd96e3d5f15d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:10.667193 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8edea4df-1118-4ab5-bfd5-bd96e3d5f15d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:10.667613 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8edea4df-1118-4ab5-bfd5-bd96e3d5f15d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:10.882156 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8edea4df-1118-4ab5-bfd5-bd96e3d5f15d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:10.891332 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8edea4df-1118-4ab5-bfd5-bd96e3d5f15d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9" status: 200 len: 1361 microversion: 2.1 time: 0.240316 Sep 01 16:41:10.891876 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 346/662] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:10 2022] GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9 => generated 1361 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:10.958427 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c240fcf1-dba9-4630-a98b-86ad7bee4505 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:10.959017 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c240fcf1-dba9-4630-a98b-86ad7bee4505 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:10.966024 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c240fcf1-dba9-4630-a98b-86ad7bee4505 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:10.966520 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c240fcf1-dba9-4630-a98b-86ad7bee4505 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:10.966956 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c240fcf1-dba9-4630-a98b-86ad7bee4505 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:10.967797 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c240fcf1-dba9-4630-a98b-86ad7bee4505 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:10.968372 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c240fcf1-dba9-4630-a98b-86ad7bee4505 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:10.968804 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c240fcf1-dba9-4630-a98b-86ad7bee4505 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:11.116779 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c240fcf1-dba9-4630-a98b-86ad7bee4505 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:11.128294 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c240fcf1-dba9-4630-a98b-86ad7bee4505 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1568 microversion: 2.1 time: 0.173728 Sep 01 16:41:11.128871 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 317/663] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:10 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:11.920016 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-cbf27a1a-2d05-46c7-b673-4dcab94395d5 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:11.920792 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-cbf27a1a-2d05-46c7-b673-4dcab94395d5 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: e5e54e2a-0163-484c-9976-1a90a8fd17b9] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:11.927610 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cbf27a1a-2d05-46c7-b673-4dcab94395d5 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:11.928205 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cbf27a1a-2d05-46c7-b673-4dcab94395d5 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:11.928680 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cbf27a1a-2d05-46c7-b673-4dcab94395d5 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:11.929431 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cbf27a1a-2d05-46c7-b673-4dcab94395d5 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:11.929874 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cbf27a1a-2d05-46c7-b673-4dcab94395d5 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:11.930295 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cbf27a1a-2d05-46c7-b673-4dcab94395d5 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:12.076151 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-cbf27a1a-2d05-46c7-b673-4dcab94395d5 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:12.085743 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-cbf27a1a-2d05-46c7-b673-4dcab94395d5 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9" status: 200 len: 1361 microversion: 2.1 time: 0.172193 Sep 01 16:41:12.086341 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 347/664] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:11 2022] GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9 => generated 1361 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:41:12.107747 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-7ed21529-ffbd-40cf-8cb4-67e6df23b7ca req-695bdd79-9d22-4745-8fef-5fd5ae040964 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5e54e2a-0163-484c-9976-1a90a8fd17b9", "name": "network-vif-plugged", "status": "completed", "tag": "b208a6b2-98cf-49b5-a8db-4c367884ea7b"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:12.119636 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-7ed21529-ffbd-40cf-8cb4-67e6df23b7ca req-695bdd79-9d22-4745-8fef-5fd5ae040964 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:12.121064 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-7ed21529-ffbd-40cf-8cb4-67e6df23b7ca req-695bdd79-9d22-4745-8fef-5fd5ae040964 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:12.121501 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-7ed21529-ffbd-40cf-8cb4-67e6df23b7ca req-695bdd79-9d22-4745-8fef-5fd5ae040964 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:12.133374 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-7ed21529-ffbd-40cf-8cb4-67e6df23b7ca req-695bdd79-9d22-4745-8fef-5fd5ae040964 service nova] Creating event network-vif-plugged:b208a6b2-98cf-49b5-a8db-4c367884ea7b for instance e5e54e2a-0163-484c-9976-1a90a8fd17b9 on hv-cinder-85221 Sep 01 16:41:12.138240 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-7ed21529-ffbd-40cf-8cb4-67e6df23b7ca req-695bdd79-9d22-4745-8fef-5fd5ae040964 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034861 Sep 01 16:41:12.139011 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 318/665] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:12.149437 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-1659a8ba-a6d7-4fa4-b449-46d83c2cde35 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:12.150078 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-1659a8ba-a6d7-4fa4-b449-46d83c2cde35 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:12.157808 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1659a8ba-a6d7-4fa4-b449-46d83c2cde35 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:12.158297 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1659a8ba-a6d7-4fa4-b449-46d83c2cde35 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:12.158733 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1659a8ba-a6d7-4fa4-b449-46d83c2cde35 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:12.159429 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1659a8ba-a6d7-4fa4-b449-46d83c2cde35 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:12.160090 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1659a8ba-a6d7-4fa4-b449-46d83c2cde35 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:12.160513 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1659a8ba-a6d7-4fa4-b449-46d83c2cde35 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:12.317325 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-1659a8ba-a6d7-4fa4-b449-46d83c2cde35 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:12.326758 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-1659a8ba-a6d7-4fa4-b449-46d83c2cde35 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1568 microversion: 2.1 time: 0.180956 Sep 01 16:41:12.327644 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 348/666] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:12 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:13.105926 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:13.113003 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-29e2c592-071f-420a-8f3d-8d39045766fa tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:13.114103 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-29e2c592-071f-420a-8f3d-8d39045766fa tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: e5e54e2a-0163-484c-9976-1a90a8fd17b9] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:13.117928 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=6 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:13.126783 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-29e2c592-071f-420a-8f3d-8d39045766fa tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:13.127269 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-29e2c592-071f-420a-8f3d-8d39045766fa tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:13.127696 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-29e2c592-071f-420a-8f3d-8d39045766fa tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:13.128412 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-29e2c592-071f-420a-8f3d-8d39045766fa tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:13.128882 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-29e2c592-071f-420a-8f3d-8d39045766fa tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:13.129270 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-29e2c592-071f-420a-8f3d-8d39045766fa tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:13.283620 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-29e2c592-071f-420a-8f3d-8d39045766fa tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:13.292114 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-29e2c592-071f-420a-8f3d-8d39045766fa tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9" status: 200 len: 1361 microversion: 2.1 time: 0.187870 Sep 01 16:41:13.292747 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 319/667] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:13 2022] GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9 => generated 1361 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:13.349293 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-23bb8878-c2b5-40fc-8d5a-2d6e45284d11 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:13.349900 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-23bb8878-c2b5-40fc-8d5a-2d6e45284d11 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:13.352133 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=6 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:13.358137 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-23bb8878-c2b5-40fc-8d5a-2d6e45284d11 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:13.358558 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-23bb8878-c2b5-40fc-8d5a-2d6e45284d11 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:13.358992 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-23bb8878-c2b5-40fc-8d5a-2d6e45284d11 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:13.359856 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-23bb8878-c2b5-40fc-8d5a-2d6e45284d11 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:13.360513 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-23bb8878-c2b5-40fc-8d5a-2d6e45284d11 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:13.360942 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-23bb8878-c2b5-40fc-8d5a-2d6e45284d11 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:13.505524 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-23bb8878-c2b5-40fc-8d5a-2d6e45284d11 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:13.516280 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-23bb8878-c2b5-40fc-8d5a-2d6e45284d11 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1568 microversion: 2.1 time: 0.170554 Sep 01 16:41:13.516869 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 349/668] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:13 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:14.313990 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-cfb53024-0c47-490b-9415-ffab4f3f9b7a tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:14.314567 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-cfb53024-0c47-490b-9415-ffab4f3f9b7a tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: e5e54e2a-0163-484c-9976-1a90a8fd17b9] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:14.321191 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cfb53024-0c47-490b-9415-ffab4f3f9b7a tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:14.321624 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cfb53024-0c47-490b-9415-ffab4f3f9b7a tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:14.322052 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cfb53024-0c47-490b-9415-ffab4f3f9b7a tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:14.322733 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cfb53024-0c47-490b-9415-ffab4f3f9b7a tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:14.323181 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cfb53024-0c47-490b-9415-ffab4f3f9b7a tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:14.323597 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cfb53024-0c47-490b-9415-ffab4f3f9b7a tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:14.465828 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-cfb53024-0c47-490b-9415-ffab4f3f9b7a tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:14.478115 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-cfb53024-0c47-490b-9415-ffab4f3f9b7a tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9" status: 200 len: 1547 microversion: 2.1 time: 0.168019 Sep 01 16:41:14.478902 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 320/669] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:14 2022] GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9 => generated 1547 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:14.501249 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ff75780c-feed-4951-9e97-62f3c03c4735 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:14.501857 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ff75780c-feed-4951-9e97-62f3c03c4735 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: e5e54e2a-0163-484c-9976-1a90a8fd17b9] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:14.508611 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ff75780c-feed-4951-9e97-62f3c03c4735 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:14.509211 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ff75780c-feed-4951-9e97-62f3c03c4735 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:14.509665 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ff75780c-feed-4951-9e97-62f3c03c4735 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:14.510379 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ff75780c-feed-4951-9e97-62f3c03c4735 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:14.510906 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ff75780c-feed-4951-9e97-62f3c03c4735 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:14.511356 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ff75780c-feed-4951-9e97-62f3c03c4735 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:14.538951 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-18f6e922-e0bc-45c3-b3ee-cf3f7a72a946 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:14.539550 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-18f6e922-e0bc-45c3-b3ee-cf3f7a72a946 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:14.546406 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-18f6e922-e0bc-45c3-b3ee-cf3f7a72a946 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:14.546885 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-18f6e922-e0bc-45c3-b3ee-cf3f7a72a946 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:14.547311 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-18f6e922-e0bc-45c3-b3ee-cf3f7a72a946 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:14.548031 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-18f6e922-e0bc-45c3-b3ee-cf3f7a72a946 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:14.548558 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-18f6e922-e0bc-45c3-b3ee-cf3f7a72a946 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:14.548974 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-18f6e922-e0bc-45c3-b3ee-cf3f7a72a946 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:14.598375 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ff75780c-feed-4951-9e97-62f3c03c4735 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100974 Sep 01 16:41:14.599281 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 350/670] 10.222.0.62 () {58 vars in 1275 bytes} [Thu Sep 1 16:41:14 2022] GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:41:14.694586 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-18f6e922-e0bc-45c3-b3ee-cf3f7a72a946 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:14.703182 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-18f6e922-e0bc-45c3-b3ee-cf3f7a72a946 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1568 microversion: 2.1 time: 0.168136 Sep 01 16:41:14.703842 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 321/671] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:14 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:41:14.825907 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-33dbace3-b32e-4f0a-b81b-71ca42ffd64f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:14.826508 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-33dbace3-b32e-4f0a-b81b-71ca42ffd64f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:14.832810 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-33dbace3-b32e-4f0a-b81b-71ca42ffd64f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:14.833288 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-33dbace3-b32e-4f0a-b81b-71ca42ffd64f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:14.833698 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-33dbace3-b32e-4f0a-b81b-71ca42ffd64f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:14.834406 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-33dbace3-b32e-4f0a-b81b-71ca42ffd64f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:14.834843 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-33dbace3-b32e-4f0a-b81b-71ca42ffd64f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:14.835251 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-33dbace3-b32e-4f0a-b81b-71ca42ffd64f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:14.918760 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.objects.instance [None req-33dbace3-b32e-4f0a-b81b-71ca42ffd64f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lazy-loading 'services' on Instance uuid f85533a0-bc5b-465a-895d-a473efbb0859 {{(pid=127199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:41:14.921127 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:15.010195 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-33dbace3-b32e-4f0a-b81b-71ca42ffd64f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "DELETE /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859/os-volume_attachments/5d2778d3-fed1-443a-9216-1350fc7e81b1" status: 202 len: 0 microversion: 2.1 time: 0.188421 Sep 01 16:41:15.010812 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 351/672] 10.222.0.62 () {58 vars in 1416 bytes} [Thu Sep 1 16:41:14 2022] DELETE /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859/os-volume_attachments/5d2778d3-fed1-443a-9216-1350fc7e81b1 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:41:15.019395 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7c1deacc-ced0-41af-8e7c-a83f16166ff3 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:15.021702 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7c1deacc-ced0-41af-8e7c-a83f16166ff3 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:15.028248 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7c1deacc-ced0-41af-8e7c-a83f16166ff3 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:15.028751 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7c1deacc-ced0-41af-8e7c-a83f16166ff3 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:15.029405 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7c1deacc-ced0-41af-8e7c-a83f16166ff3 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:15.030302 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7c1deacc-ced0-41af-8e7c-a83f16166ff3 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:15.030873 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7c1deacc-ced0-41af-8e7c-a83f16166ff3 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:15.031313 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7c1deacc-ced0-41af-8e7c-a83f16166ff3 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:15.064726 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7c1deacc-ced0-41af-8e7c-a83f16166ff3 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048970 Sep 01 16:41:15.065635 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 322/673] 10.222.0.62 () {58 vars in 1302 bytes} [Thu Sep 1 16:41:15 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:15.552156 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-676a9f3b-27d1-436a-ab46-e5a2f3e0b5ea tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:15.553069 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-676a9f3b-27d1-436a-ab46-e5a2f3e0b5ea tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: 8055f17c-aded-4b3d-99b4-6ad010bb0e77] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:15.559125 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-676a9f3b-27d1-436a-ab46-e5a2f3e0b5ea tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:15.559619 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-676a9f3b-27d1-436a-ab46-e5a2f3e0b5ea tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:15.560076 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-676a9f3b-27d1-436a-ab46-e5a2f3e0b5ea tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:15.560775 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-676a9f3b-27d1-436a-ab46-e5a2f3e0b5ea tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:15.561253 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-676a9f3b-27d1-436a-ab46-e5a2f3e0b5ea tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:15.561671 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-676a9f3b-27d1-436a-ab46-e5a2f3e0b5ea tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:15.587287 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-676a9f3b-27d1-436a-ab46-e5a2f3e0b5ea tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77/ips" status: 200 len: 150 microversion: 2.1 time: 0.039722 Sep 01 16:41:15.587849 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 352/674] 10.222.0.62 () {58 vars in 1248 bytes} [Thu Sep 1 16:41:15 2022] GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:15.726277 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-68c610ec-0e42-48f6-9ed9-5b3147727d60 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:15.726979 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-68c610ec-0e42-48f6-9ed9-5b3147727d60 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:15.738388 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-68c610ec-0e42-48f6-9ed9-5b3147727d60 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:15.739041 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-68c610ec-0e42-48f6-9ed9-5b3147727d60 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:15.739668 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-68c610ec-0e42-48f6-9ed9-5b3147727d60 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:15.740515 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-68c610ec-0e42-48f6-9ed9-5b3147727d60 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:15.741713 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-68c610ec-0e42-48f6-9ed9-5b3147727d60 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:15.742738 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-68c610ec-0e42-48f6-9ed9-5b3147727d60 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:15.808789 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-5e733df5-1f0f-4f1d-b5af-5f818ece5d6c req-c2135ce5-c104-438e-8896-1a3edb050a45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5e54e2a-0163-484c-9976-1a90a8fd17b9", "tag": "b208a6b2-98cf-49b5-a8db-4c367884ea7b"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:15.823008 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-5e733df5-1f0f-4f1d-b5af-5f818ece5d6c req-c2135ce5-c104-438e-8896-1a3edb050a45 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:15.823772 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-5e733df5-1f0f-4f1d-b5af-5f818ece5d6c req-c2135ce5-c104-438e-8896-1a3edb050a45 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:15.824688 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-5e733df5-1f0f-4f1d-b5af-5f818ece5d6c req-c2135ce5-c104-438e-8896-1a3edb050a45 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:15.837472 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-5e733df5-1f0f-4f1d-b5af-5f818ece5d6c req-c2135ce5-c104-438e-8896-1a3edb050a45 service nova] Creating event network-changed:b208a6b2-98cf-49b5-a8db-4c367884ea7b for instance e5e54e2a-0163-484c-9976-1a90a8fd17b9 on hv-cinder-85221 Sep 01 16:41:15.843417 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-5e733df5-1f0f-4f1d-b5af-5f818ece5d6c req-c2135ce5-c104-438e-8896-1a3edb050a45 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040559 Sep 01 16:41:15.844823 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 353/675] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:41:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:41:15.961093 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-68c610ec-0e42-48f6-9ed9-5b3147727d60 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:15.963297 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:15.971153 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-68c610ec-0e42-48f6-9ed9-5b3147727d60 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1568 microversion: 2.1 time: 0.249588 Sep 01 16:41:15.972372 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 323/676] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:15 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1568 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:16.079771 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-294abf22-8893-4077-8fa3-837a41f4b053 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:16.083540 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-294abf22-8893-4077-8fa3-837a41f4b053 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:16.090738 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-294abf22-8893-4077-8fa3-837a41f4b053 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:16.091616 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-294abf22-8893-4077-8fa3-837a41f4b053 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:16.091875 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-294abf22-8893-4077-8fa3-837a41f4b053 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:16.093032 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-294abf22-8893-4077-8fa3-837a41f4b053 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:16.093514 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-294abf22-8893-4077-8fa3-837a41f4b053 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:16.094173 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-294abf22-8893-4077-8fa3-837a41f4b053 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:16.131394 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-294abf22-8893-4077-8fa3-837a41f4b053 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057402 Sep 01 16:41:16.137482 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 354/677] 10.222.0.62 () {58 vars in 1302 bytes} [Thu Sep 1 16:41:16 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 16:41:16.208051 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d1bfe926-f527-4c2d-a53a-781268accdae tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:16.208638 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d1bfe926-f527-4c2d-a53a-781268accdae tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:16.215921 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d1bfe926-f527-4c2d-a53a-781268accdae tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:16.216514 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d1bfe926-f527-4c2d-a53a-781268accdae tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:16.217003 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d1bfe926-f527-4c2d-a53a-781268accdae tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:16.217919 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d1bfe926-f527-4c2d-a53a-781268accdae tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:16.218551 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d1bfe926-f527-4c2d-a53a-781268accdae tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:16.218976 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d1bfe926-f527-4c2d-a53a-781268accdae tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:16.247835 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d1bfe926-f527-4c2d-a53a-781268accdae tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Going to try to terminate instance {{(pid=127198) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:41:16.347253 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d1bfe926-f527-4c2d-a53a-781268accdae tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "DELETE /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 204 len: 0 microversion: 2.1 time: 0.142849 Sep 01 16:41:16.348618 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 324/678] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Sep 1 16:41:16 2022] DELETE /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:41:16.359936 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d024ec93-2479-4f14-bb0b-89ae4d087cc6 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:16.359936 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d024ec93-2479-4f14-bb0b-89ae4d087cc6 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:16.364973 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d024ec93-2479-4f14-bb0b-89ae4d087cc6 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:16.365751 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d024ec93-2479-4f14-bb0b-89ae4d087cc6 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:16.366245 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d024ec93-2479-4f14-bb0b-89ae4d087cc6 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:16.367071 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d024ec93-2479-4f14-bb0b-89ae4d087cc6 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:16.367583 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d024ec93-2479-4f14-bb0b-89ae4d087cc6 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:16.368103 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d024ec93-2479-4f14-bb0b-89ae4d087cc6 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:16.513622 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d024ec93-2479-4f14-bb0b-89ae4d087cc6 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:16.522518 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d024ec93-2479-4f14-bb0b-89ae4d087cc6 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 200 len: 1690 microversion: 2.1 time: 0.169748 Sep 01 16:41:16.523199 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 355/679] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:16 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:16.994141 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e2cee4e3-8c57-4d45-bae6-b622fad234b5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:16.995535 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e2cee4e3-8c57-4d45-bae6-b622fad234b5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:17.002113 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-02306393-35f7-4215-820e-c2c384b67552 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7cb1dd19-7bb1-42d4-b035-0067e3012803"}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:17.002638 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e2cee4e3-8c57-4d45-bae6-b622fad234b5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:17.003235 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e2cee4e3-8c57-4d45-bae6-b622fad234b5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:17.003697 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e2cee4e3-8c57-4d45-bae6-b622fad234b5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:17.004447 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e2cee4e3-8c57-4d45-bae6-b622fad234b5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:17.004581 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-02306393-35f7-4215-820e-c2c384b67552 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: 8055f17c-aded-4b3d-99b4-6ad010bb0e77] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:17.004900 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e2cee4e3-8c57-4d45-bae6-b622fad234b5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:17.005303 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e2cee4e3-8c57-4d45-bae6-b622fad234b5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:17.011364 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-02306393-35f7-4215-820e-c2c384b67552 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:17.011930 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-02306393-35f7-4215-820e-c2c384b67552 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:17.012500 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-02306393-35f7-4215-820e-c2c384b67552 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:17.013193 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-02306393-35f7-4215-820e-c2c384b67552 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:17.013888 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-02306393-35f7-4215-820e-c2c384b67552 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:17.014368 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-02306393-35f7-4215-820e-c2c384b67552 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:17.154707 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e2cee4e3-8c57-4d45-bae6-b622fad234b5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:17.163301 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e2cee4e3-8c57-4d45-bae6-b622fad234b5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1568 microversion: 2.1 time: 0.173313 Sep 01 16:41:17.164195 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 325/680] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:16 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:17.545924 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-497e993e-c947-41fd-9c49-43ecd00fbeb1 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:17.546464 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-497e993e-c947-41fd-9c49-43ecd00fbeb1 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:17.553460 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-497e993e-c947-41fd-9c49-43ecd00fbeb1 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:17.553943 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-497e993e-c947-41fd-9c49-43ecd00fbeb1 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:17.554377 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-497e993e-c947-41fd-9c49-43ecd00fbeb1 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:17.555069 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-497e993e-c947-41fd-9c49-43ecd00fbeb1 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:17.555516 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-497e993e-c947-41fd-9c49-43ecd00fbeb1 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:17.555944 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-497e993e-c947-41fd-9c49-43ecd00fbeb1 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:17.702837 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-497e993e-c947-41fd-9c49-43ecd00fbeb1 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:17.711228 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-497e993e-c947-41fd-9c49-43ecd00fbeb1 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 200 len: 1690 microversion: 2.1 time: 0.170530 Sep 01 16:41:17.711801 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 326/681] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:17 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 1690 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:18.186651 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e1b2c3ed-5587-4679-a83c-113956014c08 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:18.187310 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e1b2c3ed-5587-4679-a83c-113956014c08 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:18.194558 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e1b2c3ed-5587-4679-a83c-113956014c08 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:18.195039 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e1b2c3ed-5587-4679-a83c-113956014c08 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:18.195473 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e1b2c3ed-5587-4679-a83c-113956014c08 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:18.196197 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e1b2c3ed-5587-4679-a83c-113956014c08 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:18.196649 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e1b2c3ed-5587-4679-a83c-113956014c08 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:18.197069 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e1b2c3ed-5587-4679-a83c-113956014c08 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:18.336806 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e1b2c3ed-5587-4679-a83c-113956014c08 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:18.344994 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e1b2c3ed-5587-4679-a83c-113956014c08 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1568 microversion: 2.1 time: 0.162393 Sep 01 16:41:18.345536 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 327/682] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:18 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:18.740893 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a95a439f-1da8-4724-a917-99610271e992 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:18.741495 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a95a439f-1da8-4724-a917-99610271e992 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:18.748019 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a95a439f-1da8-4724-a917-99610271e992 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:18.748492 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a95a439f-1da8-4724-a917-99610271e992 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:18.748930 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a95a439f-1da8-4724-a917-99610271e992 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:18.749623 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a95a439f-1da8-4724-a917-99610271e992 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:18.750064 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a95a439f-1da8-4724-a917-99610271e992 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:18.750510 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a95a439f-1da8-4724-a917-99610271e992 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:18.884329 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a95a439f-1da8-4724-a917-99610271e992 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:18.892454 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a95a439f-1da8-4724-a917-99610271e992 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 200 len: 1690 microversion: 2.1 time: 0.155834 Sep 01 16:41:18.893042 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 328/683] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:18 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:41:19.366381 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-06dae6a6-fef2-4104-ad7b-70ca234707c6 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:19.367236 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-06dae6a6-fef2-4104-ad7b-70ca234707c6 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:19.374549 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-06dae6a6-fef2-4104-ad7b-70ca234707c6 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:19.375030 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-06dae6a6-fef2-4104-ad7b-70ca234707c6 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:19.375462 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-06dae6a6-fef2-4104-ad7b-70ca234707c6 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:19.376184 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-06dae6a6-fef2-4104-ad7b-70ca234707c6 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:19.376634 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-06dae6a6-fef2-4104-ad7b-70ca234707c6 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:19.377051 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-06dae6a6-fef2-4104-ad7b-70ca234707c6 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:19.530176 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-06dae6a6-fef2-4104-ad7b-70ca234707c6 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:19.538394 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-06dae6a6-fef2-4104-ad7b-70ca234707c6 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1568 microversion: 2.1 time: 0.176105 Sep 01 16:41:19.538972 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 329/684] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:19 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:19.916330 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b2b677a7-49ce-4e4d-8d16-c5df4000a7f8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:19.917175 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b2b677a7-49ce-4e4d-8d16-c5df4000a7f8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:19.926386 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b2b677a7-49ce-4e4d-8d16-c5df4000a7f8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:19.926880 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b2b677a7-49ce-4e4d-8d16-c5df4000a7f8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:19.927332 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b2b677a7-49ce-4e4d-8d16-c5df4000a7f8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:19.928074 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b2b677a7-49ce-4e4d-8d16-c5df4000a7f8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:19.928533 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b2b677a7-49ce-4e4d-8d16-c5df4000a7f8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:19.928963 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b2b677a7-49ce-4e4d-8d16-c5df4000a7f8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:20.170081 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-02306393-35f7-4215-820e-c2c384b67552 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "POST /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.172575 Sep 01 16:41:20.175994 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 356/685] 10.222.0.62 () {60 vars in 1323 bytes} [Thu Sep 1 16:41:16 2022] POST /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77/os-volume_attachments => generated 194 bytes in 3174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:20.264646 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b2b677a7-49ce-4e4d-8d16-c5df4000a7f8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:20.273585 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b2b677a7-49ce-4e4d-8d16-c5df4000a7f8 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 200 len: 1690 microversion: 2.1 time: 0.363909 Sep 01 16:41:20.274485 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 330/686] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:19 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 1690 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:41:20.560492 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-08ec8188-1740-4b96-bf2f-b36a3c3f758d tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:20.561085 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-08ec8188-1740-4b96-bf2f-b36a3c3f758d tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:20.568232 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-08ec8188-1740-4b96-bf2f-b36a3c3f758d tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:20.568730 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-08ec8188-1740-4b96-bf2f-b36a3c3f758d tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:20.569161 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-08ec8188-1740-4b96-bf2f-b36a3c3f758d tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:20.569867 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-08ec8188-1740-4b96-bf2f-b36a3c3f758d tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:20.570322 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-08ec8188-1740-4b96-bf2f-b36a3c3f758d tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:20.570743 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-08ec8188-1740-4b96-bf2f-b36a3c3f758d tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:20.895943 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-08ec8188-1740-4b96-bf2f-b36a3c3f758d tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:20.903906 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-08ec8188-1740-4b96-bf2f-b36a3c3f758d tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1568 microversion: 2.1 time: 0.348548 Sep 01 16:41:20.904478 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 357/687] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:20 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1568 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:21.295873 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-67842d98-65ce-40b6-a900-32542727dcb9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:21.296634 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-67842d98-65ce-40b6-a900-32542727dcb9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:21.303876 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-67842d98-65ce-40b6-a900-32542727dcb9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:21.304718 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-67842d98-65ce-40b6-a900-32542727dcb9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:21.305338 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-67842d98-65ce-40b6-a900-32542727dcb9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:21.306322 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-67842d98-65ce-40b6-a900-32542727dcb9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:21.306849 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-67842d98-65ce-40b6-a900-32542727dcb9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:21.307343 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-67842d98-65ce-40b6-a900-32542727dcb9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:21.551944 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-67842d98-65ce-40b6-a900-32542727dcb9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:21.560687 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-67842d98-65ce-40b6-a900-32542727dcb9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 200 len: 1623 microversion: 2.1 time: 0.269468 Sep 01 16:41:21.561243 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 331/688] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:21 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 1623 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:21.741064 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-8a54c242-c2cf-4044-a861-1f8220fa41a9 req-bf48f18c-947a-4a9e-85b5-0405685c5280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f85533a0-bc5b-465a-895d-a473efbb0859", "name": "network-vif-deleted", "tag": "dd7294aa-e60e-425e-98a5-e2158ff841de"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:21.746752 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:21.754751 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-8a54c242-c2cf-4044-a861-1f8220fa41a9 req-bf48f18c-947a-4a9e-85b5-0405685c5280 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:21.755372 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-8a54c242-c2cf-4044-a861-1f8220fa41a9 req-bf48f18c-947a-4a9e-85b5-0405685c5280 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:21.755916 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-8a54c242-c2cf-4044-a861-1f8220fa41a9 req-bf48f18c-947a-4a9e-85b5-0405685c5280 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:21.769276 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-8a54c242-c2cf-4044-a861-1f8220fa41a9 req-bf48f18c-947a-4a9e-85b5-0405685c5280 service nova] Creating event network-vif-deleted:dd7294aa-e60e-425e-98a5-e2158ff841de for instance f85533a0-bc5b-465a-895d-a473efbb0859 on hv-cinder-85221 Sep 01 16:41:21.775100 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-8a54c242-c2cf-4044-a861-1f8220fa41a9 req-bf48f18c-947a-4a9e-85b5-0405685c5280 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038179 Sep 01 16:41:21.775702 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 358/689] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:21.924862 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-af20d8de-fc28-485e-86da-196a41c96718 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:21.925972 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-af20d8de-fc28-485e-86da-196a41c96718 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:21.932534 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-af20d8de-fc28-485e-86da-196a41c96718 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:21.933027 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-af20d8de-fc28-485e-86da-196a41c96718 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:21.933465 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-af20d8de-fc28-485e-86da-196a41c96718 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:21.934158 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-af20d8de-fc28-485e-86da-196a41c96718 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:21.934611 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-af20d8de-fc28-485e-86da-196a41c96718 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:21.935029 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-af20d8de-fc28-485e-86da-196a41c96718 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:22.076712 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-af20d8de-fc28-485e-86da-196a41c96718 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:22.085048 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-af20d8de-fc28-485e-86da-196a41c96718 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1568 microversion: 2.1 time: 0.164450 Sep 01 16:41:22.085638 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 332/690] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:21 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:22.583854 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8e10d19a-fd7c-447c-8821-69b4dc032c3d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:22.584563 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-8e10d19a-fd7c-447c-8821-69b4dc032c3d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:22.592629 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8e10d19a-fd7c-447c-8821-69b4dc032c3d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:22.593482 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8e10d19a-fd7c-447c-8821-69b4dc032c3d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:22.594070 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8e10d19a-fd7c-447c-8821-69b4dc032c3d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:22.594860 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8e10d19a-fd7c-447c-8821-69b4dc032c3d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:22.595405 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8e10d19a-fd7c-447c-8821-69b4dc032c3d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:22.595923 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8e10d19a-fd7c-447c-8821-69b4dc032c3d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:22.641131 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8e10d19a-fd7c-447c-8821-69b4dc032c3d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:22.641647 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8e10d19a-fd7c-447c-8821-69b4dc032c3d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:22.642073 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8e10d19a-fd7c-447c-8821-69b4dc032c3d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:22.642621 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.objects.instance [None req-8e10d19a-fd7c-447c-8821-69b4dc032c3d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lazy-loading 'fault' on Instance uuid f85533a0-bc5b-465a-895d-a473efbb0859 {{(pid=127199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:41:22.691559 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8e10d19a-fd7c-447c-8821-69b4dc032c3d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:22.700420 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8e10d19a-fd7c-447c-8821-69b4dc032c3d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 200 len: 1336 microversion: 2.1 time: 0.121299 Sep 01 16:41:22.712478 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 359/691] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:22 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 1336 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:23.106313 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-47ef114d-d2f8-4811-b156-b07e20d61f42 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:23.106997 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-47ef114d-d2f8-4811-b156-b07e20d61f42 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:23.114883 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-47ef114d-d2f8-4811-b156-b07e20d61f42 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:23.115445 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-47ef114d-d2f8-4811-b156-b07e20d61f42 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:23.115880 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-47ef114d-d2f8-4811-b156-b07e20d61f42 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:23.116586 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-47ef114d-d2f8-4811-b156-b07e20d61f42 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:23.117034 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-47ef114d-d2f8-4811-b156-b07e20d61f42 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:23.117452 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-47ef114d-d2f8-4811-b156-b07e20d61f42 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:23.253628 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-47ef114d-d2f8-4811-b156-b07e20d61f42 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:23.263950 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-47ef114d-d2f8-4811-b156-b07e20d61f42 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1568 microversion: 2.1 time: 0.162676 Sep 01 16:41:23.264621 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 333/692] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:23 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:23.725269 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-53f1267a-cf23-420f-b22e-0f4778b9d554 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:23.726181 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-53f1267a-cf23-420f-b22e-0f4778b9d554 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: f85533a0-bc5b-465a-895d-a473efbb0859] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:23.736273 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-53f1267a-cf23-420f-b22e-0f4778b9d554 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:23.736983 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-53f1267a-cf23-420f-b22e-0f4778b9d554 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:23.737548 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-53f1267a-cf23-420f-b22e-0f4778b9d554 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:23.738417 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-53f1267a-cf23-420f-b22e-0f4778b9d554 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:23.738877 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-53f1267a-cf23-420f-b22e-0f4778b9d554 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:23.739295 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-53f1267a-cf23-420f-b22e-0f4778b9d554 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:23.753755 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-53f1267a-cf23-420f-b22e-0f4778b9d554 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] HTTP exception thrown: Instance f85533a0-bc5b-465a-895d-a473efbb0859 could not be found. Sep 01 16:41:23.755467 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-53f1267a-cf23-420f-b22e-0f4778b9d554 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Request method failure captured: Sep 01 16:41:23.755467 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: request: GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 HTTP/1.1 Sep 01 16:41:23.755467 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 01 16:41:23.755467 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 01 16:41:23.755467 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Connection: close Sep 01 16:41:23.755467 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 01 16:41:23.755467 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 01 16:41:23.755467 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Host: 10.222.0.62 Sep 01 16:41:23.755467 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 01 16:41:23.755467 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 01 16:41:23.755467 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjEN-Hts0Mr9WeZLVVha0OUabTAqWGElr--EmdAiOOM-cApKNFGz-VYPGEBh-XtHr4mngp8wOv7uR2S1_H1kjugmtEeioWaKFgQasL22TUHp0ruIbb4qLL0bIAqzf73Vb_OIQurxRZ_z3v0E35M_p2nrgRTWzIx_SloZcsKtKtINXJHVs Sep 01 16:41:23.755467 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 01 16:41:23.755467 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 01 16:41:23.755467 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 01 16:41:23.755467 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 01 16:41:23.755467 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 01 16:41:23.755467 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 01 16:41:23.755467 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Id: 601c248b5d9b48488351cb4d9561a2f4 Sep 01 16:41:23.755467 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-120173524 Sep 01 16:41:23.755467 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 01 16:41:23.755467 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 01 16:41:23.757021 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/601c248b5d9b48488351cb4d9561a2f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/601c248b5d9b48488351cb4d9561a2f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_601c248b5d9b48488351cb4d9561a2f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/601c248b5d9b48488351cb4d9561a2f4"}]}] Sep 01 16:41:23.757021 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-ServerRescueNegativeTestJSON-120173524 Sep 01 16:41:23.757021 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Id: 601c248b5d9b48488351cb4d9561a2f4 Sep 01 16:41:23.757021 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-120173524 Sep 01 16:41:23.757021 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User: tempest-ServerRescueNegativeTestJSON-120173524-project Sep 01 16:41:23.757021 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 01 16:41:23.757021 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 01 16:41:23.757021 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Id: 52760b6736e14ccd8df8aca0015cb292 Sep 01 16:41:23.757021 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-ServerRescueNegativeTestJSON-120173524-project Sep 01 16:41:23.757021 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: method: > Sep 01 16:41:23.757021 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: exception: Instance f85533a0-bc5b-465a-895d-a473efbb0859 could not be found. Sep 01 16:41:23.757021 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: action_args: {'id': 'f85533a0-bc5b-465a-895d-a473efbb0859'} Sep 01 16:41:23.761182 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:41:23.761182 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:23.761182 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:41:23.761182 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:41:23.761182 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:41:23.761182 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:41:23.761182 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:41:23.761182 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:41:23.761182 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:41:23.761182 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:41:23.761182 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f85533a0-bc5b-465a-895d-a473efbb0859 could not be found. Sep 01 16:41:23.761182 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:23.761182 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:23.761182 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:23.761182 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:23.761182 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:23.761182 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:23.761182 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:41:23.761182 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:41:23.761182 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:41:23.762602 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:41:23.762602 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:41:23.762602 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:41:23.762602 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:41:23.762602 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:41:23.762602 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:41:23.762602 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:41:23.762602 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f85533a0-bc5b-465a-895d-a473efbb0859 could not be found. Sep 01 16:41:23.762602 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:23.762602 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:23.762602 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:23.762602 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:23.762602 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:23.762602 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:23.762602 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:41:23.762602 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:41:23.762602 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f85533a0-bc5b-465a-895d-a473efbb0859 could not be found. Sep 01 16:41:23.762602 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:23.764300 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-53f1267a-cf23-420f-b22e-0f4778b9d554 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Returning 404 to user: Instance f85533a0-bc5b-465a-895d-a473efbb0859 could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:41:23.764300 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-53f1267a-cf23-420f-b22e-0f4778b9d554 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859" status: 404 len: 111 microversion: 2.1 time: 0.037994 Sep 01 16:41:23.764300 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 360/693] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:23 2022] GET /compute/v2.1/servers/f85533a0-bc5b-465a-895d-a473efbb0859 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:41:23.767515 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-bf6c520d-53b0-4497-8d75-ed7c2108288e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '.version_select at 0x7f9482513040>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:23.789945 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-bf6c520d-53b0-4497-8d75-ed7c2108288e tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1288977164" status: 202 len: 0 microversion: 2.1 time: 0.026179 Sep 01 16:41:23.790554 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 334/694] 10.222.0.62 () {58 vars in 1221 bytes} [Thu Sep 1 16:41:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1288977164 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:41:24.286163 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7407a5ab-299b-4ef5-ae20-69b24349a3bc tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:24.286849 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-7407a5ab-299b-4ef5-ae20-69b24349a3bc tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:24.294639 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7407a5ab-299b-4ef5-ae20-69b24349a3bc tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:24.295299 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7407a5ab-299b-4ef5-ae20-69b24349a3bc tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:24.295835 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7407a5ab-299b-4ef5-ae20-69b24349a3bc tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:24.296998 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7407a5ab-299b-4ef5-ae20-69b24349a3bc tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:24.297469 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7407a5ab-299b-4ef5-ae20-69b24349a3bc tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:24.297901 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7407a5ab-299b-4ef5-ae20-69b24349a3bc tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:24.544491 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-7407a5ab-299b-4ef5-ae20-69b24349a3bc tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:24.552730 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-7407a5ab-299b-4ef5-ae20-69b24349a3bc tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1569 microversion: 2.1 time: 0.270679 Sep 01 16:41:24.553291 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 361/695] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:24 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1569 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:24.574232 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e44ccd2a-3eb5-46b6-b9f9-5ac1cc2af969 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:24.574834 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e44ccd2a-3eb5-46b6-b9f9-5ac1cc2af969 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:24.580951 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e44ccd2a-3eb5-46b6-b9f9-5ac1cc2af969 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:24.581441 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e44ccd2a-3eb5-46b6-b9f9-5ac1cc2af969 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:24.582035 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e44ccd2a-3eb5-46b6-b9f9-5ac1cc2af969 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:24.582919 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e44ccd2a-3eb5-46b6-b9f9-5ac1cc2af969 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:24.583383 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e44ccd2a-3eb5-46b6-b9f9-5ac1cc2af969 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:24.583810 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e44ccd2a-3eb5-46b6-b9f9-5ac1cc2af969 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:24.618029 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e44ccd2a-3eb5-46b6-b9f9-5ac1cc2af969 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127198) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 01 16:41:24.691747 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e44ccd2a-3eb5-46b6-b9f9-5ac1cc2af969 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "POST /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068/action" status: 202 len: 0 microversion: 2.1 time: 0.122229 Sep 01 16:41:24.692932 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 335/696] 10.222.0.62 () {60 vars in 1278 bytes} [Thu Sep 1 16:41:24 2022] POST /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:41:24.702807 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ee952220-942b-4cb3-944c-8a098e2a3e61 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:24.703863 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ee952220-942b-4cb3-944c-8a098e2a3e61 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:24.713361 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ee952220-942b-4cb3-944c-8a098e2a3e61 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:24.714264 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ee952220-942b-4cb3-944c-8a098e2a3e61 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:24.714727 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ee952220-942b-4cb3-944c-8a098e2a3e61 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:24.715526 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ee952220-942b-4cb3-944c-8a098e2a3e61 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:24.716240 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ee952220-942b-4cb3-944c-8a098e2a3e61 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:24.716706 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ee952220-942b-4cb3-944c-8a098e2a3e61 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:24.882955 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ee952220-942b-4cb3-944c-8a098e2a3e61 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:24.890725 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ee952220-942b-4cb3-944c-8a098e2a3e61 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1517 microversion: 2.1 time: 0.192975 Sep 01 16:41:24.891283 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 362/697] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:24 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1517 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:25.914733 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c88df1ad-890d-482c-bd84-e6bab25f7cbf tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:25.915374 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c88df1ad-890d-482c-bd84-e6bab25f7cbf tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:25.922285 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c88df1ad-890d-482c-bd84-e6bab25f7cbf tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:25.922805 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c88df1ad-890d-482c-bd84-e6bab25f7cbf tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:25.923224 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c88df1ad-890d-482c-bd84-e6bab25f7cbf tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:25.923949 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c88df1ad-890d-482c-bd84-e6bab25f7cbf tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:25.924405 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c88df1ad-890d-482c-bd84-e6bab25f7cbf tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:25.924829 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c88df1ad-890d-482c-bd84-e6bab25f7cbf tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:26.074892 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c88df1ad-890d-482c-bd84-e6bab25f7cbf tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:26.084190 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c88df1ad-890d-482c-bd84-e6bab25f7cbf tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1519 microversion: 2.1 time: 0.175324 Sep 01 16:41:26.085313 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 336/698] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:25 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:26.093126 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-6e589a58-1b45-403f-8e52-3ac986f74498 req-c444318e-df7e-4342-adb7-d5262d5e9f45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca59565d-e140-4bf0-9ef3-9cc18f4d3068", "name": "network-vif-unplugged", "status": "completed", "tag": "c9213b9e-d8d2-4cdc-b268-1f9f700f72ec"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:26.106694 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-6e589a58-1b45-403f-8e52-3ac986f74498 req-c444318e-df7e-4342-adb7-d5262d5e9f45 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:26.107229 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-6e589a58-1b45-403f-8e52-3ac986f74498 req-c444318e-df7e-4342-adb7-d5262d5e9f45 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:26.107924 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-6e589a58-1b45-403f-8e52-3ac986f74498 req-c444318e-df7e-4342-adb7-d5262d5e9f45 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:26.121817 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.compute.server_external_events [req-6e589a58-1b45-403f-8e52-3ac986f74498 req-c444318e-df7e-4342-adb7-d5262d5e9f45 service nova] Unable to find a host for instance ca59565d-e140-4bf0-9ef3-9cc18f4d3068. Dropping event network-vif-unplugged {{(pid=127199) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 01 16:41:26.122876 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-6e589a58-1b45-403f-8e52-3ac986f74498 req-c444318e-df7e-4342-adb7-d5262d5e9f45 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034014 Sep 01 16:41:26.123477 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 363/699] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 01 16:41:26.998208 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e2aa6e82-0aa6-4f21-8f0d-663683d9e98c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:26.998841 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e2aa6e82-0aa6-4f21-8f0d-663683d9e98c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:27.007416 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e2aa6e82-0aa6-4f21-8f0d-663683d9e98c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:27.007945 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e2aa6e82-0aa6-4f21-8f0d-663683d9e98c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:27.008404 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e2aa6e82-0aa6-4f21-8f0d-663683d9e98c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:27.009118 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e2aa6e82-0aa6-4f21-8f0d-663683d9e98c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:27.009555 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e2aa6e82-0aa6-4f21-8f0d-663683d9e98c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:27.009968 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e2aa6e82-0aa6-4f21-8f0d-663683d9e98c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:27.038071 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e2aa6e82-0aa6-4f21-8f0d-663683d9e98c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Going to try to terminate instance {{(pid=127198) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:41:27.074441 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:27.109744 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-29a0f9c0-d594-48c2-b86f-5b2a18f53fa9 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:27.110499 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-29a0f9c0-d594-48c2-b86f-5b2a18f53fa9 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:27.118799 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-29a0f9c0-d594-48c2-b86f-5b2a18f53fa9 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:27.119293 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-29a0f9c0-d594-48c2-b86f-5b2a18f53fa9 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:27.119777 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-29a0f9c0-d594-48c2-b86f-5b2a18f53fa9 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:27.120514 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-29a0f9c0-d594-48c2-b86f-5b2a18f53fa9 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:27.120967 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-29a0f9c0-d594-48c2-b86f-5b2a18f53fa9 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:27.121566 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-29a0f9c0-d594-48c2-b86f-5b2a18f53fa9 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:27.124243 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e2aa6e82-0aa6-4f21-8f0d-663683d9e98c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "DELETE /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 204 len: 0 microversion: 2.1 time: 0.129620 Sep 01 16:41:27.125061 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 337/700] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Sep 1 16:41:26 2022] DELETE /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:41:27.135769 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-38515ae2-6b93-4ca9-bcce-438c6c88472c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:27.136644 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-38515ae2-6b93-4ca9-bcce-438c6c88472c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:27.143279 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-38515ae2-6b93-4ca9-bcce-438c6c88472c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:27.143863 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-38515ae2-6b93-4ca9-bcce-438c6c88472c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:27.144396 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-38515ae2-6b93-4ca9-bcce-438c6c88472c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:27.145159 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-38515ae2-6b93-4ca9-bcce-438c6c88472c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:27.145695 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-38515ae2-6b93-4ca9-bcce-438c6c88472c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:27.146186 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-38515ae2-6b93-4ca9-bcce-438c6c88472c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:27.329918 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-29a0f9c0-d594-48c2-b86f-5b2a18f53fa9 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:27.337165 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-38515ae2-6b93-4ca9-bcce-438c6c88472c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:27.338269 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-29a0f9c0-d594-48c2-b86f-5b2a18f53fa9 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1519 microversion: 2.1 time: 0.236137 Sep 01 16:41:27.338845 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 364/701] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:27 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1519 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:41:27.345282 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-38515ae2-6b93-4ca9-bcce-438c6c88472c tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1508 microversion: 2.1 time: 0.215669 Sep 01 16:41:27.345878 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 338/702] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:27 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1508 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:41:27.877048 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0ce0dcb6-370e-4c1b-b457-3263225a3b3c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7cb1dd19-7bb1-42d4-b035-0067e3012803"}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:27.879327 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-0ce0dcb6-370e-4c1b-b457-3263225a3b3c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: 8055f17c-aded-4b3d-99b4-6ad010bb0e77] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:27.886354 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0ce0dcb6-370e-4c1b-b457-3263225a3b3c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:27.886767 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0ce0dcb6-370e-4c1b-b457-3263225a3b3c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:27.887190 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0ce0dcb6-370e-4c1b-b457-3263225a3b3c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:27.887908 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0ce0dcb6-370e-4c1b-b457-3263225a3b3c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:27.888338 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0ce0dcb6-370e-4c1b-b457-3263225a3b3c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:27.888748 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0ce0dcb6-370e-4c1b-b457-3263225a3b3c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:27.972221 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-0ce0dcb6-370e-4c1b-b457-3263225a3b3c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] HTTP exception thrown: Invalid volume: volume 7cb1dd19-7bb1-42d4-b035-0067e3012803 is already attached to instances: 8055f17c-aded-4b3d-99b4-6ad010bb0e77 Sep 01 16:41:27.973855 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0ce0dcb6-370e-4c1b-b457-3263225a3b3c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Request method failure captured: Sep 01 16:41:27.973855 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: request: POST /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77/os-volume_attachments HTTP/1.1 Sep 01 16:41:27.973855 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 01 16:41:27.973855 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 01 16:41:27.973855 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Connection: close Sep 01 16:41:27.973855 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Length: 74 Sep 01 16:41:27.973855 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 01 16:41:27.973855 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Host: 10.222.0.62 Sep 01 16:41:27.973855 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 01 16:41:27.973855 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 01 16:41:27.973855 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjEN-Kf91-eSEr2HhmjJIIgtYULBlBY-_2maPsbMdhNYFHSV_2GN_ZKS8U6xUKw2g04Iz3Qw_Xw-tS9eWLaTCLiW-EojfuMRS-R2za92DHQcsAGlHP3o3mR6IH5zGmVt2sA1DmWsxd2yJWFWJwD0x6dDi28dXP3yLWa_ynp6SafwxV-ns Sep 01 16:41:27.973855 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 01 16:41:27.973855 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 01 16:41:27.973855 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 01 16:41:27.973855 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 01 16:41:27.973855 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 01 16:41:27.973855 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 01 16:41:27.973855 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Id: c6eb3ba21eae45898f42f3456591591e Sep 01 16:41:27.973855 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-AttachVolumeNegativeTest-1769141885 Sep 01 16:41:27.973855 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 01 16:41:27.973855 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 01 16:41:27.975416 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c6eb3ba21eae45898f42f3456591591e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c6eb3ba21eae45898f42f3456591591e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c6eb3ba21eae45898f42f3456591591e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c6eb3ba21eae45898f42f3456591591e"}]}] Sep 01 16:41:27.975416 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-AttachVolumeNegativeTest-1769141885 Sep 01 16:41:27.975416 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Id: c6eb3ba21eae45898f42f3456591591e Sep 01 16:41:27.975416 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1769141885 Sep 01 16:41:27.975416 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User: tempest-AttachVolumeNegativeTest-1769141885-project Sep 01 16:41:27.975416 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 01 16:41:27.975416 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 01 16:41:27.975416 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Id: 3a9b222396b1438f9fa0af0e197a9293 Sep 01 16:41:27.975416 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-AttachVolumeNegativeTest-1769141885-project Sep 01 16:41:27.975416 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Sep 01 16:41:27.975416 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: {"volumeAttachment": {"volumeId": "7cb1dd19-7bb1-42d4-b035-0067e3012803"}} Sep 01 16:41:27.975416 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: method: > Sep 01 16:41:27.976358 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: exception: Invalid volume: volume 7cb1dd19-7bb1-42d4-b035-0067e3012803 is already attached to instances: 8055f17c-aded-4b3d-99b4-6ad010bb0e77 Sep 01 16:41:27.976358 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: action_args: {'server_id': '8055f17c-aded-4b3d-99b4-6ad010bb0e77', 'body': {'volumeAttachment': {'volumeId': '7cb1dd19-7bb1-42d4-b035-0067e3012803'}}} Sep 01 16:41:27.976358 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:41:27.976358 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:27.976358 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 16:41:27.976358 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 16:41:27.976358 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 16:41:27.976358 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 16:41:27.976358 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 16:41:27.976358 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 16:41:27.976358 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 01 16:41:27.976358 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 01 16:41:27.976358 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 01 16:41:27.976358 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 01 16:41:27.976358 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7cb1dd19-7bb1-42d4-b035-0067e3012803 is already attached to instances: 8055f17c-aded-4b3d-99b4-6ad010bb0e77 Sep 01 16:41:27.976358 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:27.976358 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:27.976358 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:27.976358 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:27.977593 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:27.977593 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:27.977593 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:41:27.977593 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:41:27.977593 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:41:27.977593 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:41:27.977593 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 16:41:27.977593 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 16:41:27.977593 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 16:41:27.977593 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 16:41:27.977593 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 16:41:27.977593 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 16:41:27.977593 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 01 16:41:27.977593 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 16:41:27.977593 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7cb1dd19-7bb1-42d4-b035-0067e3012803 is already attached to instances: 8055f17c-aded-4b3d-99b4-6ad010bb0e77 Sep 01 16:41:27.977593 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:27.977593 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:27.977593 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:27.977593 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:27.977593 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:27.978968 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:27.978968 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:41:27.978968 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:41:27.978968 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7cb1dd19-7bb1-42d4-b035-0067e3012803 is already attached to instances: 8055f17c-aded-4b3d-99b4-6ad010bb0e77 Sep 01 16:41:27.978968 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:27.978968 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0ce0dcb6-370e-4c1b-b457-3263225a3b3c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Returning 400 to user: Invalid volume: volume 7cb1dd19-7bb1-42d4-b035-0067e3012803 is already attached to instances: 8055f17c-aded-4b3d-99b4-6ad010bb0e77 {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:41:27.978968 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-0ce0dcb6-370e-4c1b-b457-3263225a3b3c tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "POST /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102236 Sep 01 16:41:27.978968 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 365/703] 10.222.0.62 () {60 vars in 1323 bytes} [Thu Sep 1 16:41:27 2022] POST /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 16:41:28.042194 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6b01bb6c-37af-49a6-b42b-50c074942cb4 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:28.042739 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-6b01bb6c-37af-49a6-b42b-50c074942cb4 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: 8055f17c-aded-4b3d-99b4-6ad010bb0e77] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:28.049569 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6b01bb6c-37af-49a6-b42b-50c074942cb4 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:28.050048 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6b01bb6c-37af-49a6-b42b-50c074942cb4 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:28.050476 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6b01bb6c-37af-49a6-b42b-50c074942cb4 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:28.051166 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6b01bb6c-37af-49a6-b42b-50c074942cb4 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:28.051613 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6b01bb6c-37af-49a6-b42b-50c074942cb4 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:28.052063 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6b01bb6c-37af-49a6-b42b-50c074942cb4 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:28.137436 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-6b01bb6c-37af-49a6-b42b-50c074942cb4 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lazy-loading 'services' on Instance uuid 8055f17c-aded-4b3d-99b4-6ad010bb0e77 {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:41:28.224073 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-6b01bb6c-37af-49a6-b42b-50c074942cb4 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "DELETE /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77/os-volume_attachments/7cb1dd19-7bb1-42d4-b035-0067e3012803" status: 202 len: 0 microversion: 2.1 time: 0.185601 Sep 01 16:41:28.224666 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 339/704] 10.222.0.62 () {58 vars in 1416 bytes} [Thu Sep 1 16:41:28 2022] DELETE /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77/os-volume_attachments/7cb1dd19-7bb1-42d4-b035-0067e3012803 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:41:28.233600 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-bca330bd-af32-40e9-8c71-1a37fff8358f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:28.235926 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-bca330bd-af32-40e9-8c71-1a37fff8358f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: 8055f17c-aded-4b3d-99b4-6ad010bb0e77] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:28.243500 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bca330bd-af32-40e9-8c71-1a37fff8358f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:28.244012 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bca330bd-af32-40e9-8c71-1a37fff8358f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:28.244436 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bca330bd-af32-40e9-8c71-1a37fff8358f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:28.245100 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bca330bd-af32-40e9-8c71-1a37fff8358f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:28.245540 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bca330bd-af32-40e9-8c71-1a37fff8358f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:28.245949 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bca330bd-af32-40e9-8c71-1a37fff8358f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:28.275004 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-bca330bd-af32-40e9-8c71-1a37fff8358f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045434 Sep 01 16:41:28.275543 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 366/705] 10.222.0.62 () {58 vars in 1302 bytes} [Thu Sep 1 16:41:28 2022] GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:28.363252 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-eef3f0d1-7ce7-433a-9b23-a9630f234c22 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:28.364161 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-eef3f0d1-7ce7-433a-9b23-a9630f234c22 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:28.367210 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-9e51ea80-5795-48a2-822b-c6146199300b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:28.367924 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-9e51ea80-5795-48a2-822b-c6146199300b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:28.372452 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eef3f0d1-7ce7-433a-9b23-a9630f234c22 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:28.373027 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eef3f0d1-7ce7-433a-9b23-a9630f234c22 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:28.373509 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eef3f0d1-7ce7-433a-9b23-a9630f234c22 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:28.374272 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eef3f0d1-7ce7-433a-9b23-a9630f234c22 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:28.374808 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eef3f0d1-7ce7-433a-9b23-a9630f234c22 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:28.375245 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9e51ea80-5795-48a2-822b-c6146199300b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:28.375362 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eef3f0d1-7ce7-433a-9b23-a9630f234c22 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:28.375810 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9e51ea80-5795-48a2-822b-c6146199300b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:28.376377 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9e51ea80-5795-48a2-822b-c6146199300b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:28.377176 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9e51ea80-5795-48a2-822b-c6146199300b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:28.377707 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9e51ea80-5795-48a2-822b-c6146199300b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:28.378212 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9e51ea80-5795-48a2-822b-c6146199300b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:28.575913 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-eef3f0d1-7ce7-433a-9b23-a9630f234c22 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:28.578680 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-9e51ea80-5795-48a2-822b-c6146199300b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:28.584417 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-eef3f0d1-7ce7-433a-9b23-a9630f234c22 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1519 microversion: 2.1 time: 0.226408 Sep 01 16:41:28.585066 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 340/706] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:28 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1519 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:28.586384 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-9e51ea80-5795-48a2-822b-c6146199300b tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1508 microversion: 2.1 time: 0.223974 Sep 01 16:41:28.586935 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 367/707] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:28 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1508 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:29.287590 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ad5f7c38-4ec9-455a-9ea8-4940df0b2960 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:29.289962 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ad5f7c38-4ec9-455a-9ea8-4940df0b2960 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: 8055f17c-aded-4b3d-99b4-6ad010bb0e77] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:29.296502 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ad5f7c38-4ec9-455a-9ea8-4940df0b2960 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:29.296977 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ad5f7c38-4ec9-455a-9ea8-4940df0b2960 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:29.297404 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ad5f7c38-4ec9-455a-9ea8-4940df0b2960 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:29.298073 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ad5f7c38-4ec9-455a-9ea8-4940df0b2960 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:29.298513 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ad5f7c38-4ec9-455a-9ea8-4940df0b2960 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:29.298926 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ad5f7c38-4ec9-455a-9ea8-4940df0b2960 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:29.328654 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ad5f7c38-4ec9-455a-9ea8-4940df0b2960 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044919 Sep 01 16:41:29.329192 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 341/708] 10.222.0.62 () {58 vars in 1302 bytes} [Thu Sep 1 16:41:29 2022] GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:29.609051 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2311de06-defd-4a12-a512-8c45a120f5f4 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:29.609430 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d409edf5-d47e-4981-9f8f-e250deb9ec9f tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:29.609935 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-2311de06-defd-4a12-a512-8c45a120f5f4 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:29.610161 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d409edf5-d47e-4981-9f8f-e250deb9ec9f tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:29.618055 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2311de06-defd-4a12-a512-8c45a120f5f4 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:29.618582 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2311de06-defd-4a12-a512-8c45a120f5f4 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:29.619024 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2311de06-defd-4a12-a512-8c45a120f5f4 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:29.619293 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d409edf5-d47e-4981-9f8f-e250deb9ec9f tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:29.619718 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d409edf5-d47e-4981-9f8f-e250deb9ec9f tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:29.619861 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2311de06-defd-4a12-a512-8c45a120f5f4 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:29.620207 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2311de06-defd-4a12-a512-8c45a120f5f4 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:29.620363 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d409edf5-d47e-4981-9f8f-e250deb9ec9f tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:29.620618 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2311de06-defd-4a12-a512-8c45a120f5f4 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:29.621029 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d409edf5-d47e-4981-9f8f-e250deb9ec9f tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:29.621472 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d409edf5-d47e-4981-9f8f-e250deb9ec9f tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:29.621880 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d409edf5-d47e-4981-9f8f-e250deb9ec9f tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:29.925271 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d409edf5-d47e-4981-9f8f-e250deb9ec9f tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:29.933660 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d409edf5-d47e-4981-9f8f-e250deb9ec9f tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1575 microversion: 2.1 time: 0.329962 Sep 01 16:41:29.947630 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 368/709] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:29 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1575 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:29.947786 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2311de06-defd-4a12-a512-8c45a120f5f4 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:29.957445 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2311de06-defd-4a12-a512-8c45a120f5f4 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1508 microversion: 2.1 time: 0.353827 Sep 01 16:41:29.958262 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 342/710] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:29 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1508 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:30.341158 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-f5cea1c3-a7eb-4f05-a38e-5cc5b289afed tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:30.343401 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-f5cea1c3-a7eb-4f05-a38e-5cc5b289afed tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: 8055f17c-aded-4b3d-99b4-6ad010bb0e77] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:30.350443 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f5cea1c3-a7eb-4f05-a38e-5cc5b289afed tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:30.350924 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f5cea1c3-a7eb-4f05-a38e-5cc5b289afed tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:30.351347 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f5cea1c3-a7eb-4f05-a38e-5cc5b289afed tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:30.352075 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f5cea1c3-a7eb-4f05-a38e-5cc5b289afed tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:30.352671 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f5cea1c3-a7eb-4f05-a38e-5cc5b289afed tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:30.352910 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f5cea1c3-a7eb-4f05-a38e-5cc5b289afed tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:30.368558 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:30.385793 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-48c9f552-7b24-40d4-885f-5343cde4b2ee req-e426625a-6c9b-448e-b057-b38df6973d9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3be929ac-f249-4540-9ff2-3519a68231ff", "name": "network-vif-deleted", "tag": "d904d72e-18b3-41a4-aba4-c49c839b8377"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:30.398663 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-48c9f552-7b24-40d4-885f-5343cde4b2ee req-e426625a-6c9b-448e-b057-b38df6973d9c service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:30.399126 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-48c9f552-7b24-40d4-885f-5343cde4b2ee req-e426625a-6c9b-448e-b057-b38df6973d9c service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:30.399551 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-48c9f552-7b24-40d4-885f-5343cde4b2ee req-e426625a-6c9b-448e-b057-b38df6973d9c service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:30.409884 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-f5cea1c3-a7eb-4f05-a38e-5cc5b289afed tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072483 Sep 01 16:41:30.410591 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 369/711] 10.222.0.62 () {58 vars in 1302 bytes} [Thu Sep 1 16:41:30 2022] GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 16:41:30.420115 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-48c9f552-7b24-40d4-885f-5343cde4b2ee req-e426625a-6c9b-448e-b057-b38df6973d9c service nova] Creating event network-vif-deleted:d904d72e-18b3-41a4-aba4-c49c839b8377 for instance 3be929ac-f249-4540-9ff2-3519a68231ff on hv-cinder-85221 Sep 01 16:41:30.427602 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-48c9f552-7b24-40d4-885f-5343cde4b2ee req-e426625a-6c9b-448e-b057-b38df6973d9c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045279 Sep 01 16:41:30.432075 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 343/712] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:30.491205 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-56757c66-f816-45fa-8c38-a5dca8f05465 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:30.491830 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-56757c66-f816-45fa-8c38-a5dca8f05465 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: 8055f17c-aded-4b3d-99b4-6ad010bb0e77] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:30.499939 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-56757c66-f816-45fa-8c38-a5dca8f05465 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:30.500464 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-56757c66-f816-45fa-8c38-a5dca8f05465 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:30.500918 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-56757c66-f816-45fa-8c38-a5dca8f05465 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:30.501645 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-56757c66-f816-45fa-8c38-a5dca8f05465 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:30.502110 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-56757c66-f816-45fa-8c38-a5dca8f05465 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:30.502532 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-56757c66-f816-45fa-8c38-a5dca8f05465 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:30.529203 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-56757c66-f816-45fa-8c38-a5dca8f05465 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: 8055f17c-aded-4b3d-99b4-6ad010bb0e77] Going to try to terminate instance {{(pid=127199) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:41:30.612571 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-56757c66-f816-45fa-8c38-a5dca8f05465 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "DELETE /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77" status: 204 len: 0 microversion: 2.1 time: 0.125135 Sep 01 16:41:30.615321 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 370/713] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Sep 1 16:41:30 2022] DELETE /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:41:30.624961 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c0dd941b-3fb2-470e-aee7-2710a04c8d77 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:30.626450 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c0dd941b-3fb2-470e-aee7-2710a04c8d77 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: 8055f17c-aded-4b3d-99b4-6ad010bb0e77] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:30.633419 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c0dd941b-3fb2-470e-aee7-2710a04c8d77 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:30.636119 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c0dd941b-3fb2-470e-aee7-2710a04c8d77 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:30.636929 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c0dd941b-3fb2-470e-aee7-2710a04c8d77 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:30.638104 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c0dd941b-3fb2-470e-aee7-2710a04c8d77 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:30.639093 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c0dd941b-3fb2-470e-aee7-2710a04c8d77 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:30.639671 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c0dd941b-3fb2-470e-aee7-2710a04c8d77 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:30.787075 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c0dd941b-3fb2-470e-aee7-2710a04c8d77 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:30.796403 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c0dd941b-3fb2-470e-aee7-2710a04c8d77 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77" status: 200 len: 1682 microversion: 2.1 time: 0.176478 Sep 01 16:41:30.797011 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 344/714] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:30 2022] GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77 => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:30.957734 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-9983f94e-07f3-4d41-b363-fc27146360ff tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:30.958489 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-9983f94e-07f3-4d41-b363-fc27146360ff tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:30.965824 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9983f94e-07f3-4d41-b363-fc27146360ff tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:30.966306 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9983f94e-07f3-4d41-b363-fc27146360ff tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:30.966730 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9983f94e-07f3-4d41-b363-fc27146360ff tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:30.967414 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9983f94e-07f3-4d41-b363-fc27146360ff tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:30.967852 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9983f94e-07f3-4d41-b363-fc27146360ff tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:30.968300 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9983f94e-07f3-4d41-b363-fc27146360ff tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:30.979016 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-fbdf7781-c7b5-439b-8b3a-683b9e8ced79 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:30.979624 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-fbdf7781-c7b5-439b-8b3a-683b9e8ced79 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:30.986007 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fbdf7781-c7b5-439b-8b3a-683b9e8ced79 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:30.986495 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fbdf7781-c7b5-439b-8b3a-683b9e8ced79 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:30.986930 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fbdf7781-c7b5-439b-8b3a-683b9e8ced79 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:30.987624 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fbdf7781-c7b5-439b-8b3a-683b9e8ced79 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:30.988109 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fbdf7781-c7b5-439b-8b3a-683b9e8ced79 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:30.988534 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fbdf7781-c7b5-439b-8b3a-683b9e8ced79 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:31.021112 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fbdf7781-c7b5-439b-8b3a-683b9e8ced79 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:31.021470 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fbdf7781-c7b5-439b-8b3a-683b9e8ced79 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:31.021907 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fbdf7781-c7b5-439b-8b3a-683b9e8ced79 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:31.022717 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-fbdf7781-c7b5-439b-8b3a-683b9e8ced79 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lazy-loading 'fault' on Instance uuid 3be929ac-f249-4540-9ff2-3519a68231ff {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:41:31.068017 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-fbdf7781-c7b5-439b-8b3a-683b9e8ced79 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:31.077067 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-fbdf7781-c7b5-439b-8b3a-683b9e8ced79 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1312 microversion: 2.1 time: 0.102240 Sep 01 16:41:31.077665 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 345/715] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:30 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1312 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:31.127646 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-9983f94e-07f3-4d41-b363-fc27146360ff tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:31.136328 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-9983f94e-07f3-4d41-b363-fc27146360ff tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1575 microversion: 2.1 time: 0.183996 Sep 01 16:41:31.136897 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 371/716] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:30 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1575 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:31.818718 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d3453524-4d6b-4b3d-87f0-0c70bab76464 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:31.819418 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d3453524-4d6b-4b3d-87f0-0c70bab76464 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: 8055f17c-aded-4b3d-99b4-6ad010bb0e77] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:31.826697 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d3453524-4d6b-4b3d-87f0-0c70bab76464 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:31.827188 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d3453524-4d6b-4b3d-87f0-0c70bab76464 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:31.827620 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d3453524-4d6b-4b3d-87f0-0c70bab76464 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:31.828354 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d3453524-4d6b-4b3d-87f0-0c70bab76464 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:31.828814 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d3453524-4d6b-4b3d-87f0-0c70bab76464 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:31.829238 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d3453524-4d6b-4b3d-87f0-0c70bab76464 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:31.973814 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d3453524-4d6b-4b3d-87f0-0c70bab76464 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:31.982487 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d3453524-4d6b-4b3d-87f0-0c70bab76464 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77" status: 200 len: 1682 microversion: 2.1 time: 0.167617 Sep 01 16:41:31.983159 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 346/717] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:31 2022] GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:32.098101 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-3425a1c7-a5e9-4a73-a9fb-8a4c894b77d9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:32.098770 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-3425a1c7-a5e9-4a73-a9fb-8a4c894b77d9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:32.105807 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3425a1c7-a5e9-4a73-a9fb-8a4c894b77d9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:32.106289 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3425a1c7-a5e9-4a73-a9fb-8a4c894b77d9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:32.106713 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3425a1c7-a5e9-4a73-a9fb-8a4c894b77d9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:32.107400 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3425a1c7-a5e9-4a73-a9fb-8a4c894b77d9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:32.107842 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3425a1c7-a5e9-4a73-a9fb-8a4c894b77d9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:32.108269 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3425a1c7-a5e9-4a73-a9fb-8a4c894b77d9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:32.140488 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3425a1c7-a5e9-4a73-a9fb-8a4c894b77d9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:32.140948 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3425a1c7-a5e9-4a73-a9fb-8a4c894b77d9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:32.141368 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3425a1c7-a5e9-4a73-a9fb-8a4c894b77d9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:32.141806 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.objects.instance [None req-3425a1c7-a5e9-4a73-a9fb-8a4c894b77d9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lazy-loading 'fault' on Instance uuid 3be929ac-f249-4540-9ff2-3519a68231ff {{(pid=127199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:41:32.156877 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-92249006-39db-4fab-be53-8ef0a9854434 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:32.157500 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-92249006-39db-4fab-be53-8ef0a9854434 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:32.164691 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-92249006-39db-4fab-be53-8ef0a9854434 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:32.165178 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-92249006-39db-4fab-be53-8ef0a9854434 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:32.165606 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-92249006-39db-4fab-be53-8ef0a9854434 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:32.166350 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-92249006-39db-4fab-be53-8ef0a9854434 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:32.166808 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-92249006-39db-4fab-be53-8ef0a9854434 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:32.168027 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-92249006-39db-4fab-be53-8ef0a9854434 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:32.199003 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-3425a1c7-a5e9-4a73-a9fb-8a4c894b77d9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:32.208889 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-3425a1c7-a5e9-4a73-a9fb-8a4c894b77d9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 200 len: 1312 microversion: 2.1 time: 0.114426 Sep 01 16:41:32.209453 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 372/718] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:32 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 1312 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:32.357776 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-92249006-39db-4fab-be53-8ef0a9854434 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:32.365673 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-92249006-39db-4fab-be53-8ef0a9854434 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1575 microversion: 2.1 time: 0.212620 Sep 01 16:41:32.366415 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 347/719] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:32 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1575 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:33.005661 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-fa1ccfa9-bfa0-44a4-92c7-7f2fe4bdda81 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:33.006308 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-fa1ccfa9-bfa0-44a4-92c7-7f2fe4bdda81 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: 8055f17c-aded-4b3d-99b4-6ad010bb0e77] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:33.013027 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fa1ccfa9-bfa0-44a4-92c7-7f2fe4bdda81 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:33.013519 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fa1ccfa9-bfa0-44a4-92c7-7f2fe4bdda81 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:33.013928 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fa1ccfa9-bfa0-44a4-92c7-7f2fe4bdda81 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:33.014660 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fa1ccfa9-bfa0-44a4-92c7-7f2fe4bdda81 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:33.015112 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fa1ccfa9-bfa0-44a4-92c7-7f2fe4bdda81 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:33.015533 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fa1ccfa9-bfa0-44a4-92c7-7f2fe4bdda81 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:33.229579 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9e72249d-f440-45da-9a7d-d0cfdc33e7f9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:33.230172 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9e72249d-f440-45da-9a7d-d0cfdc33e7f9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 3be929ac-f249-4540-9ff2-3519a68231ff] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:33.237166 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9e72249d-f440-45da-9a7d-d0cfdc33e7f9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:33.237656 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9e72249d-f440-45da-9a7d-d0cfdc33e7f9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:33.238082 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9e72249d-f440-45da-9a7d-d0cfdc33e7f9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:33.238792 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9e72249d-f440-45da-9a7d-d0cfdc33e7f9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:33.239222 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9e72249d-f440-45da-9a7d-d0cfdc33e7f9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:33.239642 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9e72249d-f440-45da-9a7d-d0cfdc33e7f9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:33.258872 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-fa1ccfa9-bfa0-44a4-92c7-7f2fe4bdda81 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:33.260167 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-9e72249d-f440-45da-9a7d-d0cfdc33e7f9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] HTTP exception thrown: Instance 3be929ac-f249-4540-9ff2-3519a68231ff could not be found. Sep 01 16:41:33.261830 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9e72249d-f440-45da-9a7d-d0cfdc33e7f9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Request method failure captured: Sep 01 16:41:33.261830 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff HTTP/1.1 Sep 01 16:41:33.261830 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 01 16:41:33.261830 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 01 16:41:33.261830 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Connection: close Sep 01 16:41:33.261830 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 01 16:41:33.261830 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 01 16:41:33.261830 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Host: 10.222.0.62 Sep 01 16:41:33.261830 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 01 16:41:33.261830 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 01 16:41:33.261830 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjEN-Hts0Mr9WeZLVVha0OUabTAqWGElr--EmdAiOOM-cApKNFGz-VYPGEBh-XtHr4mngp8wOv7uR2S1_H1kjugmtEeioWaKFgQasL22TUHp0ruIbb4qLL0bIAqzf73Vb_OIQurxRZ_z3v0E35M_p2nrgRTWzIx_SloZcsKtKtINXJHVs Sep 01 16:41:33.261830 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 01 16:41:33.261830 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 01 16:41:33.261830 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 01 16:41:33.261830 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 01 16:41:33.261830 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 01 16:41:33.261830 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 01 16:41:33.261830 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Id: 601c248b5d9b48488351cb4d9561a2f4 Sep 01 16:41:33.261830 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-120173524 Sep 01 16:41:33.261830 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 01 16:41:33.261830 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 01 16:41:33.263423 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/601c248b5d9b48488351cb4d9561a2f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/601c248b5d9b48488351cb4d9561a2f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_601c248b5d9b48488351cb4d9561a2f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/601c248b5d9b48488351cb4d9561a2f4"}]}] Sep 01 16:41:33.263423 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-ServerRescueNegativeTestJSON-120173524 Sep 01 16:41:33.263423 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Id: 601c248b5d9b48488351cb4d9561a2f4 Sep 01 16:41:33.263423 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-120173524 Sep 01 16:41:33.263423 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User: tempest-ServerRescueNegativeTestJSON-120173524-project Sep 01 16:41:33.263423 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 01 16:41:33.263423 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 01 16:41:33.263423 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Id: 52760b6736e14ccd8df8aca0015cb292 Sep 01 16:41:33.263423 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-ServerRescueNegativeTestJSON-120173524-project Sep 01 16:41:33.263423 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: method: > Sep 01 16:41:33.263423 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: exception: Instance 3be929ac-f249-4540-9ff2-3519a68231ff could not be found. Sep 01 16:41:33.263423 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: action_args: {'id': '3be929ac-f249-4540-9ff2-3519a68231ff'} Sep 01 16:41:33.265828 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:41:33.265828 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:33.265828 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:41:33.265828 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:41:33.265828 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:41:33.265828 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:41:33.265828 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:41:33.265828 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:41:33.265828 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:41:33.265828 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:41:33.265828 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3be929ac-f249-4540-9ff2-3519a68231ff could not be found. Sep 01 16:41:33.265828 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:41:33.265828 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:33.265828 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:41:33.265828 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:33.265828 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:33.265828 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:33.265828 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:41:33.265828 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:41:33.265828 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:41:33.269875 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:41:33.269875 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:41:33.269875 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:41:33.269875 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:41:33.269875 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:41:33.269875 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:41:33.269875 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:41:33.269875 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3be929ac-f249-4540-9ff2-3519a68231ff could not be found. Sep 01 16:41:33.269875 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:41:33.269875 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:33.269875 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:41:33.269875 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:33.269875 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:33.269875 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:33.269875 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:41:33.269875 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:41:33.269875 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3be929ac-f249-4540-9ff2-3519a68231ff could not be found. Sep 01 16:41:33.269875 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:41:33.272674 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9e72249d-f440-45da-9a7d-d0cfdc33e7f9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Returning 404 to user: Instance 3be929ac-f249-4540-9ff2-3519a68231ff could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:41:33.272674 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9e72249d-f440-45da-9a7d-d0cfdc33e7f9 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff" status: 404 len: 111 microversion: 2.1 time: 0.037607 Sep 01 16:41:33.272674 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 348/720] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:33 2022] GET /compute/v2.1/servers/3be929ac-f249-4540-9ff2-3519a68231ff => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:41:33.272674 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-04ed7d18-8df7-43a9-8d95-4ddc6e046d39 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:33.272674 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-04ed7d18-8df7-43a9-8d95-4ddc6e046d39 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:33.278712 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-04ed7d18-8df7-43a9-8d95-4ddc6e046d39 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:33.279205 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-04ed7d18-8df7-43a9-8d95-4ddc6e046d39 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:33.279635 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-04ed7d18-8df7-43a9-8d95-4ddc6e046d39 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:33.280358 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-04ed7d18-8df7-43a9-8d95-4ddc6e046d39 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:33.280805 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-04ed7d18-8df7-43a9-8d95-4ddc6e046d39 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:33.281226 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-04ed7d18-8df7-43a9-8d95-4ddc6e046d39 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:33.284272 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-fa1ccfa9-bfa0-44a4-92c7-7f2fe4bdda81 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77" status: 200 len: 1682 microversion: 2.1 time: 0.283004 Sep 01 16:41:33.284853 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 373/721] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:32 2022] GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77 => generated 1682 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:33.308872 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-04ed7d18-8df7-43a9-8d95-4ddc6e046d39 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Going to try to terminate instance {{(pid=127198) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:41:33.394025 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-04ed7d18-8df7-43a9-8d95-4ddc6e046d39 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "DELETE /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648" status: 204 len: 0 microversion: 2.1 time: 0.125386 Sep 01 16:41:33.395415 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 349/722] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Sep 1 16:41:33 2022] DELETE /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:41:33.396102 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d6f93931-f153-49ce-9a97-885e931f8cf1 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:33.398904 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d6f93931-f153-49ce-9a97-885e931f8cf1 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:33.405952 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-4a008666-3d71-4498-89d5-402529c409c7 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:33.407057 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-4a008666-3d71-4498-89d5-402529c409c7 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:33.413015 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4a008666-3d71-4498-89d5-402529c409c7 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:33.413510 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4a008666-3d71-4498-89d5-402529c409c7 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:33.413932 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4a008666-3d71-4498-89d5-402529c409c7 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:33.415171 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4a008666-3d71-4498-89d5-402529c409c7 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:33.415292 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d6f93931-f153-49ce-9a97-885e931f8cf1 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:33.415388 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4a008666-3d71-4498-89d5-402529c409c7 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:33.415917 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d6f93931-f153-49ce-9a97-885e931f8cf1 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:33.416040 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4a008666-3d71-4498-89d5-402529c409c7 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:33.421442 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d6f93931-f153-49ce-9a97-885e931f8cf1 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:33.422366 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d6f93931-f153-49ce-9a97-885e931f8cf1 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:33.422840 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d6f93931-f153-49ce-9a97-885e931f8cf1 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:33.423272 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d6f93931-f153-49ce-9a97-885e931f8cf1 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:33.665293 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-4a008666-3d71-4498-89d5-402529c409c7 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:33.673483 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-4a008666-3d71-4498-89d5-402529c409c7 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648" status: 200 len: 1522 microversion: 2.1 time: 0.273209 Sep 01 16:41:33.674316 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 350/723] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:33 2022] GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:33.688283 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d6f93931-f153-49ce-9a97-885e931f8cf1 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:33.698014 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d6f93931-f153-49ce-9a97-885e931f8cf1 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1575 microversion: 2.1 time: 0.313604 Sep 01 16:41:33.698594 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 374/724] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:33 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1575 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:41:33.831954 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-3eedb9f2-e6a6-4ec2-8afb-1a2f28f90482 req-3ff450f5-d5ef-494b-8fe7-a3fd3c85f3bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8055f17c-aded-4b3d-99b4-6ad010bb0e77", "name": "network-vif-deleted", "tag": "c8924c93-a074-4f3a-82f3-f2e637b26f42"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:33.843369 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-3eedb9f2-e6a6-4ec2-8afb-1a2f28f90482 req-3ff450f5-d5ef-494b-8fe7-a3fd3c85f3bd service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:33.844174 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-3eedb9f2-e6a6-4ec2-8afb-1a2f28f90482 req-3ff450f5-d5ef-494b-8fe7-a3fd3c85f3bd service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:33.844612 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-3eedb9f2-e6a6-4ec2-8afb-1a2f28f90482 req-3ff450f5-d5ef-494b-8fe7-a3fd3c85f3bd service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:33.858140 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-3eedb9f2-e6a6-4ec2-8afb-1a2f28f90482 req-3ff450f5-d5ef-494b-8fe7-a3fd3c85f3bd service nova] Creating event network-vif-deleted:c8924c93-a074-4f3a-82f3-f2e637b26f42 for instance 8055f17c-aded-4b3d-99b4-6ad010bb0e77 on hv-cinder-85221 Sep 01 16:41:33.863371 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-3eedb9f2-e6a6-4ec2-8afb-1a2f28f90482 req-3ff450f5-d5ef-494b-8fe7-a3fd3c85f3bd service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035172 Sep 01 16:41:33.864170 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 351/725] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:34.309658 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-11e0554e-2a56-4d7d-87d1-b3b691423a0b tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:34.310262 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-11e0554e-2a56-4d7d-87d1-b3b691423a0b tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: 8055f17c-aded-4b3d-99b4-6ad010bb0e77] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:34.316786 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-11e0554e-2a56-4d7d-87d1-b3b691423a0b tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:34.317264 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-11e0554e-2a56-4d7d-87d1-b3b691423a0b tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:34.317717 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-11e0554e-2a56-4d7d-87d1-b3b691423a0b tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:34.318399 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-11e0554e-2a56-4d7d-87d1-b3b691423a0b tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:34.318875 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-11e0554e-2a56-4d7d-87d1-b3b691423a0b tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:34.319468 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-11e0554e-2a56-4d7d-87d1-b3b691423a0b tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:34.395969 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-11e0554e-2a56-4d7d-87d1-b3b691423a0b tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:34.404586 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-11e0554e-2a56-4d7d-87d1-b3b691423a0b tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77" status: 200 len: 1615 microversion: 2.1 time: 0.098707 Sep 01 16:41:34.405167 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 375/726] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:34 2022] GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77 => generated 1615 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:34.695603 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5ee21f47-e864-45a4-a88c-f5c96eb14800 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:34.696361 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5ee21f47-e864-45a4-a88c-f5c96eb14800 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:34.700373 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4,nova_api:DELETE=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:34.704419 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5ee21f47-e864-45a4-a88c-f5c96eb14800 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:34.705643 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5ee21f47-e864-45a4-a88c-f5c96eb14800 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:34.706070 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5ee21f47-e864-45a4-a88c-f5c96eb14800 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:34.706971 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5ee21f47-e864-45a4-a88c-f5c96eb14800 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:34.707425 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5ee21f47-e864-45a4-a88c-f5c96eb14800 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:34.707866 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5ee21f47-e864-45a4-a88c-f5c96eb14800 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:34.720588 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-df2c1668-e4c3-4f18-89c9-650d2a8d313e tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:34.721186 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-df2c1668-e4c3-4f18-89c9-650d2a8d313e tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:34.731828 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-df2c1668-e4c3-4f18-89c9-650d2a8d313e tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:34.732346 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-df2c1668-e4c3-4f18-89c9-650d2a8d313e tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:34.732767 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-df2c1668-e4c3-4f18-89c9-650d2a8d313e tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:34.733453 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-df2c1668-e4c3-4f18-89c9-650d2a8d313e tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:34.733898 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-df2c1668-e4c3-4f18-89c9-650d2a8d313e tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:34.734463 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-df2c1668-e4c3-4f18-89c9-650d2a8d313e tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:34.906133 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5ee21f47-e864-45a4-a88c-f5c96eb14800 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:34.922333 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5ee21f47-e864-45a4-a88c-f5c96eb14800 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648" status: 200 len: 1522 microversion: 2.1 time: 0.230907 Sep 01 16:41:34.923179 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 352/727] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:34 2022] GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:34.936529 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-df2c1668-e4c3-4f18-89c9-650d2a8d313e tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:34.942259 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-df2c1668-e4c3-4f18-89c9-650d2a8d313e tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1575 microversion: 2.1 time: 0.226009 Sep 01 16:41:34.942820 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 376/728] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:34 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1575 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:35.429029 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-335f537e-3fa8-4e81-8127-026b705542e8 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:35.429663 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-335f537e-3fa8-4e81-8127-026b705542e8 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: 8055f17c-aded-4b3d-99b4-6ad010bb0e77] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:35.437449 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-335f537e-3fa8-4e81-8127-026b705542e8 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:35.438052 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-335f537e-3fa8-4e81-8127-026b705542e8 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:35.438543 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-335f537e-3fa8-4e81-8127-026b705542e8 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:35.439244 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-335f537e-3fa8-4e81-8127-026b705542e8 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:35.439697 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-335f537e-3fa8-4e81-8127-026b705542e8 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:35.440305 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-335f537e-3fa8-4e81-8127-026b705542e8 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:35.444651 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:35.516811 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-335f537e-3fa8-4e81-8127-026b705542e8 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:35.527056 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-335f537e-3fa8-4e81-8127-026b705542e8 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77" status: 200 len: 1615 microversion: 2.1 time: 0.103628 Sep 01 16:41:35.527631 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 353/729] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:35 2022] GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77 => generated 1615 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:35.943860 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-dc99ddc0-1001-4c9c-983e-0e5460d0445f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:35.945197 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-dc99ddc0-1001-4c9c-983e-0e5460d0445f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:35.955980 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dc99ddc0-1001-4c9c-983e-0e5460d0445f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:35.956756 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dc99ddc0-1001-4c9c-983e-0e5460d0445f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:35.957446 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dc99ddc0-1001-4c9c-983e-0e5460d0445f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:35.958264 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dc99ddc0-1001-4c9c-983e-0e5460d0445f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:35.958710 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dc99ddc0-1001-4c9c-983e-0e5460d0445f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:35.959098 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dc99ddc0-1001-4c9c-983e-0e5460d0445f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:35.964701 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-df503c2e-f65e-4e5d-8616-dd7f116a97a9 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:35.965392 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-df503c2e-f65e-4e5d-8616-dd7f116a97a9 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:35.972231 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-df503c2e-f65e-4e5d-8616-dd7f116a97a9 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:35.972718 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-df503c2e-f65e-4e5d-8616-dd7f116a97a9 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:35.973153 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-df503c2e-f65e-4e5d-8616-dd7f116a97a9 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:35.973846 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-df503c2e-f65e-4e5d-8616-dd7f116a97a9 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:35.974296 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-df503c2e-f65e-4e5d-8616-dd7f116a97a9 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:35.974714 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-df503c2e-f65e-4e5d-8616-dd7f116a97a9 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:36.157204 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-dc99ddc0-1001-4c9c-983e-0e5460d0445f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:36.165966 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-df503c2e-f65e-4e5d-8616-dd7f116a97a9 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:36.166163 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-dc99ddc0-1001-4c9c-983e-0e5460d0445f tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648" status: 200 len: 1522 microversion: 2.1 time: 0.226136 Sep 01 16:41:36.166889 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 377/730] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:35 2022] GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:36.174166 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-df503c2e-f65e-4e5d-8616-dd7f116a97a9 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1575 microversion: 2.1 time: 0.213288 Sep 01 16:41:36.174768 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 354/731] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:35 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1575 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:36.548874 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-446e2005-0114-4078-ae95-782d6cf52016 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:36.549748 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-446e2005-0114-4078-ae95-782d6cf52016 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: 8055f17c-aded-4b3d-99b4-6ad010bb0e77] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:36.556530 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-446e2005-0114-4078-ae95-782d6cf52016 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:36.557037 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-446e2005-0114-4078-ae95-782d6cf52016 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:36.557461 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-446e2005-0114-4078-ae95-782d6cf52016 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:36.558251 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-446e2005-0114-4078-ae95-782d6cf52016 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:36.558602 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-446e2005-0114-4078-ae95-782d6cf52016 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:36.559014 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-446e2005-0114-4078-ae95-782d6cf52016 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:36.594134 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-446e2005-0114-4078-ae95-782d6cf52016 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:36.594809 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-446e2005-0114-4078-ae95-782d6cf52016 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:36.594904 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-446e2005-0114-4078-ae95-782d6cf52016 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:36.595372 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.objects.instance [None req-446e2005-0114-4078-ae95-782d6cf52016 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lazy-loading 'fault' on Instance uuid 8055f17c-aded-4b3d-99b4-6ad010bb0e77 {{(pid=127199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:41:36.637503 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-446e2005-0114-4078-ae95-782d6cf52016 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:36.645701 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-446e2005-0114-4078-ae95-782d6cf52016 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77" status: 200 len: 1332 microversion: 2.1 time: 0.100777 Sep 01 16:41:36.646621 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 378/732] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:36 2022] GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77 => generated 1332 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:37.192476 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e00c6e37-bc19-40ef-8409-f6bf62a33ff3 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:37.194543 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e00c6e37-bc19-40ef-8409-f6bf62a33ff3 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:37.197091 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7793b94a-9940-4148-9ff4-452f9e7e7e1a tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:37.199394 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-7793b94a-9940-4148-9ff4-452f9e7e7e1a tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:37.209636 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e00c6e37-bc19-40ef-8409-f6bf62a33ff3 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:37.209875 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7793b94a-9940-4148-9ff4-452f9e7e7e1a tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:37.210254 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7793b94a-9940-4148-9ff4-452f9e7e7e1a tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:37.210668 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e00c6e37-bc19-40ef-8409-f6bf62a33ff3 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:37.210809 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7793b94a-9940-4148-9ff4-452f9e7e7e1a tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:37.211268 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e00c6e37-bc19-40ef-8409-f6bf62a33ff3 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:37.211388 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7793b94a-9940-4148-9ff4-452f9e7e7e1a tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:37.211799 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7793b94a-9940-4148-9ff4-452f9e7e7e1a tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:37.212244 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e00c6e37-bc19-40ef-8409-f6bf62a33ff3 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:37.212345 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7793b94a-9940-4148-9ff4-452f9e7e7e1a tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:37.212896 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e00c6e37-bc19-40ef-8409-f6bf62a33ff3 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:37.213402 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e00c6e37-bc19-40ef-8409-f6bf62a33ff3 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:37.498165 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e00c6e37-bc19-40ef-8409-f6bf62a33ff3 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:37.503860 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-7793b94a-9940-4148-9ff4-452f9e7e7e1a tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:37.508926 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e00c6e37-bc19-40ef-8409-f6bf62a33ff3 tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648" status: 200 len: 1522 microversion: 2.1 time: 0.323132 Sep 01 16:41:37.514425 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-7793b94a-9940-4148-9ff4-452f9e7e7e1a tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1575 microversion: 2.1 time: 0.322501 Sep 01 16:41:37.514969 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 379/733] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:37 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1575 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:37.519058 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 355/734] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:37 2022] GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648 => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:37.660976 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-d0b2595e-cae0-479b-b7ec-29324e2dbe05 req-18819a83-50de-412b-920c-b62fdebf8821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5537b019-c314-4b22-bde4-b19b3641c648", "name": "network-vif-deleted", "tag": "63af1365-37ee-4010-8c55-df1561b93a9a"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:37.667976 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-16687818-aca4-49a0-a2a4-e67552b72fb0 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:37.669082 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-16687818-aca4-49a0-a2a4-e67552b72fb0 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: 8055f17c-aded-4b3d-99b4-6ad010bb0e77] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:37.671787 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-d0b2595e-cae0-479b-b7ec-29324e2dbe05 req-18819a83-50de-412b-920c-b62fdebf8821 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:37.672475 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-d0b2595e-cae0-479b-b7ec-29324e2dbe05 req-18819a83-50de-412b-920c-b62fdebf8821 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:37.672895 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-d0b2595e-cae0-479b-b7ec-29324e2dbe05 req-18819a83-50de-412b-920c-b62fdebf8821 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:37.675301 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-16687818-aca4-49a0-a2a4-e67552b72fb0 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:37.676007 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-16687818-aca4-49a0-a2a4-e67552b72fb0 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:37.676642 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-16687818-aca4-49a0-a2a4-e67552b72fb0 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:37.677471 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-16687818-aca4-49a0-a2a4-e67552b72fb0 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:37.677920 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-16687818-aca4-49a0-a2a4-e67552b72fb0 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:37.678533 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-16687818-aca4-49a0-a2a4-e67552b72fb0 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:37.686937 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-d0b2595e-cae0-479b-b7ec-29324e2dbe05 req-18819a83-50de-412b-920c-b62fdebf8821 service nova] Creating event network-vif-deleted:63af1365-37ee-4010-8c55-df1561b93a9a for instance 5537b019-c314-4b22-bde4-b19b3641c648 on hv-cinder-85221 Sep 01 16:41:37.691950 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-d0b2595e-cae0-479b-b7ec-29324e2dbe05 req-18819a83-50de-412b-920c-b62fdebf8821 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035206 Sep 01 16:41:37.692553 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 380/735] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:37.694390 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-16687818-aca4-49a0-a2a4-e67552b72fb0 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] HTTP exception thrown: Instance 8055f17c-aded-4b3d-99b4-6ad010bb0e77 could not be found. Sep 01 16:41:37.696427 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-16687818-aca4-49a0-a2a4-e67552b72fb0 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Request method failure captured: Sep 01 16:41:37.696427 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77 HTTP/1.1 Sep 01 16:41:37.696427 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 01 16:41:37.696427 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 01 16:41:37.696427 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Connection: close Sep 01 16:41:37.696427 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 01 16:41:37.696427 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 01 16:41:37.696427 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Host: 10.222.0.62 Sep 01 16:41:37.696427 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 01 16:41:37.696427 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 01 16:41:37.696427 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjEN-Kf91-eSEr2HhmjJIIgtYULBlBY-_2maPsbMdhNYFHSV_2GN_ZKS8U6xUKw2g04Iz3Qw_Xw-tS9eWLaTCLiW-EojfuMRS-R2za92DHQcsAGlHP3o3mR6IH5zGmVt2sA1DmWsxd2yJWFWJwD0x6dDi28dXP3yLWa_ynp6SafwxV-ns Sep 01 16:41:37.696427 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 01 16:41:37.696427 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 01 16:41:37.696427 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 01 16:41:37.696427 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 01 16:41:37.696427 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 01 16:41:37.696427 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 01 16:41:37.696427 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Id: c6eb3ba21eae45898f42f3456591591e Sep 01 16:41:37.696427 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-AttachVolumeNegativeTest-1769141885 Sep 01 16:41:37.696427 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 01 16:41:37.696427 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 01 16:41:37.698000 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c6eb3ba21eae45898f42f3456591591e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c6eb3ba21eae45898f42f3456591591e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c6eb3ba21eae45898f42f3456591591e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c6eb3ba21eae45898f42f3456591591e"}]}] Sep 01 16:41:37.698000 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-AttachVolumeNegativeTest-1769141885 Sep 01 16:41:37.698000 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Id: c6eb3ba21eae45898f42f3456591591e Sep 01 16:41:37.698000 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1769141885 Sep 01 16:41:37.698000 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User: tempest-AttachVolumeNegativeTest-1769141885-project Sep 01 16:41:37.698000 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 01 16:41:37.698000 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 01 16:41:37.698000 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Id: 3a9b222396b1438f9fa0af0e197a9293 Sep 01 16:41:37.698000 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-AttachVolumeNegativeTest-1769141885-project Sep 01 16:41:37.698000 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: method: > Sep 01 16:41:37.698000 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: exception: Instance 8055f17c-aded-4b3d-99b4-6ad010bb0e77 could not be found. Sep 01 16:41:37.698000 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: action_args: {'id': '8055f17c-aded-4b3d-99b4-6ad010bb0e77'} Sep 01 16:41:37.699393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:41:37.699393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:37.699393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:41:37.699393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:41:37.699393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:41:37.699393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:41:37.699393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:41:37.699393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:41:37.699393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:41:37.699393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:41:37.699393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8055f17c-aded-4b3d-99b4-6ad010bb0e77 could not be found. Sep 01 16:41:37.699393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:41:37.699393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:37.699393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:41:37.699393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:37.699393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:37.699393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:37.699393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:41:37.699393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:41:37.699393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:41:37.700804 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:41:37.700804 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:41:37.700804 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:41:37.700804 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:41:37.700804 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:41:37.700804 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:41:37.700804 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:41:37.700804 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8055f17c-aded-4b3d-99b4-6ad010bb0e77 could not be found. Sep 01 16:41:37.700804 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:41:37.700804 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:37.700804 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:41:37.700804 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:37.700804 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:37.700804 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:37.700804 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:41:37.700804 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:41:37.700804 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8055f17c-aded-4b3d-99b4-6ad010bb0e77 could not be found. Sep 01 16:41:37.700804 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:41:37.702035 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-16687818-aca4-49a0-a2a4-e67552b72fb0 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Returning 404 to user: Instance 8055f17c-aded-4b3d-99b4-6ad010bb0e77 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:41:37.702035 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-16687818-aca4-49a0-a2a4-e67552b72fb0 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77" status: 404 len: 111 microversion: 2.1 time: 0.035197 Sep 01 16:41:37.702216 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 356/736] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:37 2022] GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:41:37.707457 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-6fc0f803-6ce9-47b4-b61b-cfd5436e9107 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '.version_select at 0x7f948232fc10>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:37.729734 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-6fc0f803-6ce9-47b4-b61b-cfd5436e9107 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1263511324" status: 202 len: 0 microversion: 2.1 time: 0.026257 Sep 01 16:41:37.730326 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 381/737] 10.222.0.62 () {58 vars in 1221 bytes} [Thu Sep 1 16:41:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1263511324 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:41:38.216445 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-35ea9353-d247-4512-bdb9-4100580ff0b9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:38.216953 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-35ea9353-d247-4512-bdb9-4100580ff0b9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:38.223592 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-35ea9353-d247-4512-bdb9-4100580ff0b9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:38.224128 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-35ea9353-d247-4512-bdb9-4100580ff0b9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:38.224569 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-35ea9353-d247-4512-bdb9-4100580ff0b9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:38.225380 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-35ea9353-d247-4512-bdb9-4100580ff0b9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:38.225855 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-35ea9353-d247-4512-bdb9-4100580ff0b9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:38.226266 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-35ea9353-d247-4512-bdb9-4100580ff0b9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:38.250870 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-35ea9353-d247-4512-bdb9-4100580ff0b9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b/ips" status: 200 len: 152 microversion: 2.20 time: 0.096513 Sep 01 16:41:38.251539 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 357/738] 10.222.0.62 () {60 vars in 1289 bytes} [Thu Sep 1 16:41:38 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b/ips => generated 152 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:41:38.405949 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-12f5baf2-8345-4520-80c3-1cb6f8de5ac3 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Action: 'create', calling method: .version_select at 0x7f948232a550>, body: {"keypair": {"name": "tempest-keypair-64666956", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAguoMU7GysWsfNZ1PB6yqqArGgpGl9u1d7EE42KB5fQ7Xm27zCc1f+i02tNj+6GAaaj5+ezfwcWJZzcILI6RgI3W+50+S3rNr3HxctywY9g8IGgJDVcWGaiU4Se1MRVmA=="}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:38.425284 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-12f5baf2-8345-4520-80c3-1cb6f8de5ac3 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Getting quotas for project c6eb3ba21eae45898f42f3456591591e. Resources: {'key_pairs'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:41:38.430359 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-12f5baf2-8345-4520-80c3-1cb6f8de5ac3 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Getting quotas for user 3a9b222396b1438f9fa0af0e197a9293 and project c6eb3ba21eae45898f42f3456591591e. Resources: {'key_pairs'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:41:38.459747 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-12f5baf2-8345-4520-80c3-1cb6f8de5ac3 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.058386 Sep 01 16:41:38.460632 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 382/739] 10.222.0.62 () {60 vars in 1159 bytes} [Thu Sep 1 16:41:38 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:41:38.531310 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-23613ced-3b14-4d12-9ebb-6f3db59ddf0d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:38.537073 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-05f374a9-eb50-4dbc-a067-fd555c831db1 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:38.537742 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-05f374a9-eb50-4dbc-a067-fd555c831db1 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:38.539156 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-23613ced-3b14-4d12-9ebb-6f3db59ddf0d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:38.559251 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-23613ced-3b14-4d12-9ebb-6f3db59ddf0d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:38.561511 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-23613ced-3b14-4d12-9ebb-6f3db59ddf0d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:38.563881 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-23613ced-3b14-4d12-9ebb-6f3db59ddf0d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:38.568195 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-23613ced-3b14-4d12-9ebb-6f3db59ddf0d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:38.568548 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-05f374a9-eb50-4dbc-a067-fd555c831db1 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:38.569689 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-23613ced-3b14-4d12-9ebb-6f3db59ddf0d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:38.570844 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-05f374a9-eb50-4dbc-a067-fd555c831db1 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:38.572051 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-23613ced-3b14-4d12-9ebb-6f3db59ddf0d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:38.572242 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-05f374a9-eb50-4dbc-a067-fd555c831db1 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:38.574446 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-05f374a9-eb50-4dbc-a067-fd555c831db1 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:38.575420 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-05f374a9-eb50-4dbc-a067-fd555c831db1 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:38.575834 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-05f374a9-eb50-4dbc-a067-fd555c831db1 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:38.617729 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-23613ced-3b14-4d12-9ebb-6f3db59ddf0d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:38.618314 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-23613ced-3b14-4d12-9ebb-6f3db59ddf0d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:38.618815 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-23613ced-3b14-4d12-9ebb-6f3db59ddf0d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:38.619678 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-23613ced-3b14-4d12-9ebb-6f3db59ddf0d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lazy-loading 'fault' on Instance uuid 5537b019-c314-4b22-bde4-b19b3641c648 {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:41:38.706942 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-23613ced-3b14-4d12-9ebb-6f3db59ddf0d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52760b6736e14ccd8df8aca0015cb292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601c248b5d9b48488351cb4d9561a2f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:38.715857 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-23613ced-3b14-4d12-9ebb-6f3db59ddf0d tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648" status: 200 len: 1312 microversion: 2.1 time: 0.188592 Sep 01 16:41:38.716467 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 358/740] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:38 2022] GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648 => generated 1312 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:38.825107 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-05f374a9-eb50-4dbc-a067-fd555c831db1 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:38.833475 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-05f374a9-eb50-4dbc-a067-fd555c831db1 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1575 microversion: 2.1 time: 0.300532 Sep 01 16:41:38.834053 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 383/741] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:38 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1575 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:39.738565 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-417e3682-a067-48a2-9fc3-c03cc7e7d5ff tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:39.739171 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-417e3682-a067-48a2-9fc3-c03cc7e7d5ff tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] [instance: 5537b019-c314-4b22-bde4-b19b3641c648] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:39.749090 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-417e3682-a067-48a2-9fc3-c03cc7e7d5ff tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:39.749588 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-417e3682-a067-48a2-9fc3-c03cc7e7d5ff tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:39.750223 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-417e3682-a067-48a2-9fc3-c03cc7e7d5ff tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:39.750941 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-417e3682-a067-48a2-9fc3-c03cc7e7d5ff tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:39.751401 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-417e3682-a067-48a2-9fc3-c03cc7e7d5ff tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:39.752032 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-417e3682-a067-48a2-9fc3-c03cc7e7d5ff tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:39.772464 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-417e3682-a067-48a2-9fc3-c03cc7e7d5ff tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] HTTP exception thrown: Instance 5537b019-c314-4b22-bde4-b19b3641c648 could not be found. Sep 01 16:41:39.774393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-417e3682-a067-48a2-9fc3-c03cc7e7d5ff tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Request method failure captured: Sep 01 16:41:39.774393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648 HTTP/1.1 Sep 01 16:41:39.774393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 01 16:41:39.774393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 01 16:41:39.774393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Connection: close Sep 01 16:41:39.774393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 01 16:41:39.774393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 01 16:41:39.774393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Host: 10.222.0.62 Sep 01 16:41:39.774393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 01 16:41:39.774393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 01 16:41:39.774393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjEN-Hts0Mr9WeZLVVha0OUabTAqWGElr--EmdAiOOM-cApKNFGz-VYPGEBh-XtHr4mngp8wOv7uR2S1_H1kjugmtEeioWaKFgQasL22TUHp0ruIbb4qLL0bIAqzf73Vb_OIQurxRZ_z3v0E35M_p2nrgRTWzIx_SloZcsKtKtINXJHVs Sep 01 16:41:39.774393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 01 16:41:39.774393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 01 16:41:39.774393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 01 16:41:39.774393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 01 16:41:39.774393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 01 16:41:39.774393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 01 16:41:39.774393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Id: 601c248b5d9b48488351cb4d9561a2f4 Sep 01 16:41:39.774393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-120173524 Sep 01 16:41:39.774393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 01 16:41:39.774393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 01 16:41:39.775735 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/601c248b5d9b48488351cb4d9561a2f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/601c248b5d9b48488351cb4d9561a2f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_601c248b5d9b48488351cb4d9561a2f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/601c248b5d9b48488351cb4d9561a2f4"}]}] Sep 01 16:41:39.775735 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-ServerRescueNegativeTestJSON-120173524 Sep 01 16:41:39.775735 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Id: 601c248b5d9b48488351cb4d9561a2f4 Sep 01 16:41:39.775735 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-120173524 Sep 01 16:41:39.775735 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User: tempest-ServerRescueNegativeTestJSON-120173524-project Sep 01 16:41:39.775735 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 01 16:41:39.775735 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 01 16:41:39.775735 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Id: 52760b6736e14ccd8df8aca0015cb292 Sep 01 16:41:39.775735 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-ServerRescueNegativeTestJSON-120173524-project Sep 01 16:41:39.775735 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: method: > Sep 01 16:41:39.775735 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: exception: Instance 5537b019-c314-4b22-bde4-b19b3641c648 could not be found. Sep 01 16:41:39.775735 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: action_args: {'id': '5537b019-c314-4b22-bde4-b19b3641c648'} Sep 01 16:41:39.776569 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:41:39.776569 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:39.776569 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:41:39.776569 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:41:39.776569 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:41:39.776569 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:41:39.776569 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:41:39.776569 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:41:39.776569 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:41:39.776569 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:41:39.776569 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5537b019-c314-4b22-bde4-b19b3641c648 could not be found. Sep 01 16:41:39.776569 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:41:39.776569 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:39.776569 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:41:39.776569 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:39.776569 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:39.776569 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:39.776569 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:41:39.776569 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:41:39.776569 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:41:39.777717 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:41:39.777717 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:41:39.777717 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:41:39.777717 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:41:39.777717 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:41:39.777717 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:41:39.777717 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:41:39.777717 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5537b019-c314-4b22-bde4-b19b3641c648 could not be found. Sep 01 16:41:39.777717 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:41:39.777717 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:39.777717 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:41:39.777717 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:39.777717 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:39.777717 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:39.777717 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:41:39.777717 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:41:39.777717 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5537b019-c314-4b22-bde4-b19b3641c648 could not be found. Sep 01 16:41:39.777717 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:41:39.778751 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-417e3682-a067-48a2-9fc3-c03cc7e7d5ff tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] Returning 404 to user: Instance 5537b019-c314-4b22-bde4-b19b3641c648 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:41:39.778751 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-417e3682-a067-48a2-9fc3-c03cc7e7d5ff tempest-ServerRescueNegativeTestJSON-120173524 tempest-ServerRescueNegativeTestJSON-120173524-project] 10.222.0.62 "GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648" status: 404 len: 111 microversion: 2.1 time: 0.041378 Sep 01 16:41:39.778751 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 359/742] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:39 2022] GET /compute/v2.1/servers/5537b019-c314-4b22-bde4-b19b3641c648 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:41:39.857610 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-cfc0b6c1-d71c-4057-8cfd-8dc236deaafd tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:39.858315 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-cfc0b6c1-d71c-4057-8cfd-8dc236deaafd tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:39.864937 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cfc0b6c1-d71c-4057-8cfd-8dc236deaafd tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:39.865405 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cfc0b6c1-d71c-4057-8cfd-8dc236deaafd tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:39.865954 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cfc0b6c1-d71c-4057-8cfd-8dc236deaafd tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:39.866974 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cfc0b6c1-d71c-4057-8cfd-8dc236deaafd tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:39.867401 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cfc0b6c1-d71c-4057-8cfd-8dc236deaafd tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:39.868047 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cfc0b6c1-d71c-4057-8cfd-8dc236deaafd tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:39.954189 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-12442766-489b-48e7-8d59-2c3cc365869f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-177538218", "imageRef": "49e5276c-002c-454f-8be8-76deb18b6b28", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3ad8e59d-1d82-4cdb-9afd-98e6a7c8e50a"}], "security_groups": [{"name": "tempest-securitygroup--727464375"}], "key_name": "tempest-keypair-64666956", "user_data": "}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:40.020976 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-cfc0b6c1-d71c-4057-8cfd-8dc236deaafd tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:40.032513 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-cfc0b6c1-d71c-4057-8cfd-8dc236deaafd tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1575 microversion: 2.1 time: 0.179665 Sep 01 16:41:40.033989 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 384/743] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:39 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1575 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:40.071640 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.network.neutron [None req-12442766-489b-48e7-8d59-2c3cc365869f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] validate_networks() for [('3ad8e59d-1d82-4cdb-9afd-98e6a7c8e50a', None, None, None, None, None)] {{(pid=127198) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:41:40.091521 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-de0745ca-a94c-49f6-9ec3-f9a15996013b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:40.092078 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-de0745ca-a94c-49f6-9ec3-f9a15996013b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:40.098404 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-de0745ca-a94c-49f6-9ec3-f9a15996013b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:40.099111 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-de0745ca-a94c-49f6-9ec3-f9a15996013b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:40.099736 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-de0745ca-a94c-49f6-9ec3-f9a15996013b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:40.100957 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-de0745ca-a94c-49f6-9ec3-f9a15996013b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:40.101604 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-de0745ca-a94c-49f6-9ec3-f9a15996013b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:40.102225 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-de0745ca-a94c-49f6-9ec3-f9a15996013b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:40.132781 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.objects.instance [None req-de0745ca-a94c-49f6-9ec3-f9a15996013b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lazy-loading 'flavor' on Instance uuid 0ae2e10f-5b22-4257-b92d-bc87e0df662b {{(pid=127199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:41:40.171073 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:40.383684 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-de0745ca-a94c-49f6-9ec3-f9a15996013b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "POST /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b/action" status: 202 len: 0 microversion: 2.20 time: 0.296151 Sep 01 16:41:40.384501 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 385/744] 10.222.0.62 () {62 vars in 1319 bytes} [Thu Sep 1 16:41:40 2022] POST /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 01 16:41:40.393897 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-591b1dd1-9768-4ca9-b5e9-53d6d831bf7d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:40.394602 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-591b1dd1-9768-4ca9-b5e9-53d6d831bf7d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:40.401373 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-591b1dd1-9768-4ca9-b5e9-53d6d831bf7d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:40.402097 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-591b1dd1-9768-4ca9-b5e9-53d6d831bf7d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:40.402535 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-591b1dd1-9768-4ca9-b5e9-53d6d831bf7d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:40.403435 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-591b1dd1-9768-4ca9-b5e9-53d6d831bf7d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:40.403853 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-591b1dd1-9768-4ca9-b5e9-53d6d831bf7d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:40.404324 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-591b1dd1-9768-4ca9-b5e9-53d6d831bf7d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:40.651852 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-591b1dd1-9768-4ca9-b5e9-53d6d831bf7d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:40.666001 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-591b1dd1-9768-4ca9-b5e9-53d6d831bf7d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:40.667667 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-591b1dd1-9768-4ca9-b5e9-53d6d831bf7d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:40.669334 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-591b1dd1-9768-4ca9-b5e9-53d6d831bf7d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1724 microversion: 2.20 time: 0.280273 Sep 01 16:41:40.671021 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 386/745] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:40 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1724 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:40.697682 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-12442766-489b-48e7-8d59-2c3cc365869f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Flavor limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:41:40.698125 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-12442766-489b-48e7-8d59-2c3cc365869f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Image limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:41:40.699090 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-12442766-489b-48e7-8d59-2c3cc365869f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Flavor pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:41:40.699499 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-12442766-489b-48e7-8d59-2c3cc365869f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Image pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:41:40.699960 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-12442766-489b-48e7-8d59-2c3cc365869f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:41:40.708826 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-12442766-489b-48e7-8d59-2c3cc365869f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:40.710376 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-12442766-489b-48e7-8d59-2c3cc365869f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:40.711086 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-12442766-489b-48e7-8d59-2c3cc365869f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:40.712093 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-12442766-489b-48e7-8d59-2c3cc365869f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:40.712769 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-12442766-489b-48e7-8d59-2c3cc365869f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:40.713557 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-12442766-489b-48e7-8d59-2c3cc365869f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:40.734151 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-12442766-489b-48e7-8d59-2c3cc365869f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Getting quotas for project c6eb3ba21eae45898f42f3456591591e. Resources: {'ram', 'cores', 'instances'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:41:40.738116 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-12442766-489b-48e7-8d59-2c3cc365869f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Getting quotas for user 3a9b222396b1438f9fa0af0e197a9293 and project c6eb3ba21eae45898f42f3456591591e. Resources: {'ram', 'cores', 'instances'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:41:40.759651 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-12442766-489b-48e7-8d59-2c3cc365869f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Going to run 1 instances... {{(pid=127198) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:41:40.762217 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-12442766-489b-48e7-8d59-2c3cc365869f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: cd88a09b-04d0-4c19-b78e-cedce17f0956] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='49e5276c-002c-454f-8be8-76deb18b6b28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:41:40.816578 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-12442766-489b-48e7-8d59-2c3cc365869f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.866817 Sep 01 16:41:40.817213 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 360/746] 10.222.0.62 () {60 vars in 1147 bytes} [Thu Sep 1 16:41:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 16:41:40.829679 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-13b979e2-f8d6-42bd-a4a4-126c563b1082 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:40.830338 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-13b979e2-f8d6-42bd-a4a4-126c563b1082 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: cd88a09b-04d0-4c19-b78e-cedce17f0956] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:40.899070 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-13b979e2-f8d6-42bd-a4a4-126c563b1082 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:40.908847 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-13b979e2-f8d6-42bd-a4a4-126c563b1082 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956" status: 200 len: 1239 microversion: 2.1 time: 0.083020 Sep 01 16:41:40.909818 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 387/747] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:40 2022] GET /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956 => generated 1239 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:41.056378 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-12a2c7a6-8e73-46fe-af5c-cdac01f90875 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:41.057065 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-12a2c7a6-8e73-46fe-af5c-cdac01f90875 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:41.064644 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-12a2c7a6-8e73-46fe-af5c-cdac01f90875 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:41.065424 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-12a2c7a6-8e73-46fe-af5c-cdac01f90875 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:41.066109 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-12a2c7a6-8e73-46fe-af5c-cdac01f90875 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:41.067074 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-12a2c7a6-8e73-46fe-af5c-cdac01f90875 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:41.067858 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-12a2c7a6-8e73-46fe-af5c-cdac01f90875 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:41.068807 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-12a2c7a6-8e73-46fe-af5c-cdac01f90875 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:41.245166 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-12a2c7a6-8e73-46fe-af5c-cdac01f90875 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:41.254045 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-12a2c7a6-8e73-46fe-af5c-cdac01f90875 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1575 microversion: 2.1 time: 0.203023 Sep 01 16:41:41.254586 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 361/748] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:41 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1575 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:41.695039 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-356aaa49-3747-4220-acf4-099bd0ce4e90 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:41.695924 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-356aaa49-3747-4220-acf4-099bd0ce4e90 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:41.703106 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-356aaa49-3747-4220-acf4-099bd0ce4e90 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:41.703555 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-356aaa49-3747-4220-acf4-099bd0ce4e90 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:41.704538 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-356aaa49-3747-4220-acf4-099bd0ce4e90 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:41.705267 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-356aaa49-3747-4220-acf4-099bd0ce4e90 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:41.705802 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-356aaa49-3747-4220-acf4-099bd0ce4e90 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:41.706212 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-356aaa49-3747-4220-acf4-099bd0ce4e90 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:41.870338 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-356aaa49-3747-4220-acf4-099bd0ce4e90 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:41.878831 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-356aaa49-3747-4220-acf4-099bd0ce4e90 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:41.880439 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-356aaa49-3747-4220-acf4-099bd0ce4e90 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:41.881889 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-356aaa49-3747-4220-acf4-099bd0ce4e90 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1724 microversion: 2.20 time: 0.191595 Sep 01 16:41:41.882451 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 388/749] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:41 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:41.930491 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b2ccc1db-4d86-4fd3-912d-06595ba7c0fe tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:41.931047 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b2ccc1db-4d86-4fd3-912d-06595ba7c0fe tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: cd88a09b-04d0-4c19-b78e-cedce17f0956] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:41.937452 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b2ccc1db-4d86-4fd3-912d-06595ba7c0fe tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:41.937938 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b2ccc1db-4d86-4fd3-912d-06595ba7c0fe tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:41.938382 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b2ccc1db-4d86-4fd3-912d-06595ba7c0fe tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:41.939083 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b2ccc1db-4d86-4fd3-912d-06595ba7c0fe tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:41.939540 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b2ccc1db-4d86-4fd3-912d-06595ba7c0fe tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:41.939998 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b2ccc1db-4d86-4fd3-912d-06595ba7c0fe tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:42.004820 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b2ccc1db-4d86-4fd3-912d-06595ba7c0fe tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:42.013792 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b2ccc1db-4d86-4fd3-912d-06595ba7c0fe tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956" status: 200 len: 1291 microversion: 2.1 time: 0.087407 Sep 01 16:41:42.014952 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 362/750] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:41 2022] GET /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956 => generated 1291 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:42.228931 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-cbf903d0-9e57-483c-9933-9e7a6f6b58ee req-995761cb-eb7c-4f2f-84cc-053980fdd5a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca59565d-e140-4bf0-9ef3-9cc18f4d3068", "name": "network-vif-plugged", "status": "completed", "tag": "c9213b9e-d8d2-4cdc-b268-1f9f700f72ec"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:42.248930 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-cbf903d0-9e57-483c-9933-9e7a6f6b58ee req-995761cb-eb7c-4f2f-84cc-053980fdd5a9 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:42.249699 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-cbf903d0-9e57-483c-9933-9e7a6f6b58ee req-995761cb-eb7c-4f2f-84cc-053980fdd5a9 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:42.250269 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-cbf903d0-9e57-483c-9933-9e7a6f6b58ee req-995761cb-eb7c-4f2f-84cc-053980fdd5a9 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:42.275553 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f125eccc-9c8f-4034-b7a1-989bcc33a4ce tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:42.276362 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f125eccc-9c8f-4034-b7a1-989bcc33a4ce tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:42.285405 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f125eccc-9c8f-4034-b7a1-989bcc33a4ce tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:42.286406 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-cbf903d0-9e57-483c-9933-9e7a6f6b58ee req-995761cb-eb7c-4f2f-84cc-053980fdd5a9 service nova] Creating event network-vif-plugged:c9213b9e-d8d2-4cdc-b268-1f9f700f72ec for instance ca59565d-e140-4bf0-9ef3-9cc18f4d3068 on hv-cinder-85221 Sep 01 16:41:42.286986 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f125eccc-9c8f-4034-b7a1-989bcc33a4ce tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:42.290020 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f125eccc-9c8f-4034-b7a1-989bcc33a4ce tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:42.290904 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f125eccc-9c8f-4034-b7a1-989bcc33a4ce tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:42.291484 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f125eccc-9c8f-4034-b7a1-989bcc33a4ce tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:42.296599 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f125eccc-9c8f-4034-b7a1-989bcc33a4ce tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:42.300317 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-cbf903d0-9e57-483c-9933-9e7a6f6b58ee req-995761cb-eb7c-4f2f-84cc-053980fdd5a9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072154 Sep 01 16:41:42.302442 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 389/751] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:42.539766 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f125eccc-9c8f-4034-b7a1-989bcc33a4ce tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:42.553195 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f125eccc-9c8f-4034-b7a1-989bcc33a4ce tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1575 microversion: 2.1 time: 0.281304 Sep 01 16:41:42.569519 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 363/752] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:42 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1575 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:42.906304 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-cb777feb-f15a-4cc1-a247-de7896694bc1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:42.907226 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-cb777feb-f15a-4cc1-a247-de7896694bc1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:42.914657 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cb777feb-f15a-4cc1-a247-de7896694bc1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:42.915376 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cb777feb-f15a-4cc1-a247-de7896694bc1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:42.916191 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cb777feb-f15a-4cc1-a247-de7896694bc1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:42.917081 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cb777feb-f15a-4cc1-a247-de7896694bc1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:42.917740 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cb777feb-f15a-4cc1-a247-de7896694bc1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:42.918360 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cb777feb-f15a-4cc1-a247-de7896694bc1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:43.037940 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5cac816f-50db-4eb4-a3e1-928e2f6be615 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:43.039152 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5cac816f-50db-4eb4-a3e1-928e2f6be615 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: cd88a09b-04d0-4c19-b78e-cedce17f0956] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:43.046445 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5cac816f-50db-4eb4-a3e1-928e2f6be615 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:43.047025 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5cac816f-50db-4eb4-a3e1-928e2f6be615 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:43.047524 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5cac816f-50db-4eb4-a3e1-928e2f6be615 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:43.048343 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5cac816f-50db-4eb4-a3e1-928e2f6be615 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:43.049017 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5cac816f-50db-4eb4-a3e1-928e2f6be615 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:43.049500 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5cac816f-50db-4eb4-a3e1-928e2f6be615 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:43.167251 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5cac816f-50db-4eb4-a3e1-928e2f6be615 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:43.170081 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-cb777feb-f15a-4cc1-a247-de7896694bc1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:43.181047 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5cac816f-50db-4eb4-a3e1-928e2f6be615 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956" status: 200 len: 1297 microversion: 2.1 time: 0.147379 Sep 01 16:41:43.181479 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-cb777feb-f15a-4cc1-a247-de7896694bc1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:43.183188 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-cb777feb-f15a-4cc1-a247-de7896694bc1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:43.184669 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-cb777feb-f15a-4cc1-a247-de7896694bc1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1724 microversion: 2.20 time: 0.283246 Sep 01 16:41:43.186549 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 364/753] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:43 2022] GET /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956 => generated 1297 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:43.207437 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 390/754] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:42 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1724 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:43.579538 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0767eb36-a9af-48a9-9746-13d5d7dfaa46 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:43.580187 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0767eb36-a9af-48a9-9746-13d5d7dfaa46 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:43.591959 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0767eb36-a9af-48a9-9746-13d5d7dfaa46 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:43.594165 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0767eb36-a9af-48a9-9746-13d5d7dfaa46 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:43.596408 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0767eb36-a9af-48a9-9746-13d5d7dfaa46 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:43.597744 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0767eb36-a9af-48a9-9746-13d5d7dfaa46 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:43.600406 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0767eb36-a9af-48a9-9746-13d5d7dfaa46 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:43.602278 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0767eb36-a9af-48a9-9746-13d5d7dfaa46 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:43.902870 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0767eb36-a9af-48a9-9746-13d5d7dfaa46 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:43.912510 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0767eb36-a9af-48a9-9746-13d5d7dfaa46 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1575 microversion: 2.1 time: 0.338020 Sep 01 16:41:43.913372 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 365/755] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:43 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1575 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:44.227956 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c5eea168-621b-48e5-88cb-a1aefd19cd72 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:44.229215 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9c250d73-f74b-4952-80c9-0eb2d00ded8a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:44.229934 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9c250d73-f74b-4952-80c9-0eb2d00ded8a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: cd88a09b-04d0-4c19-b78e-cedce17f0956] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:44.230126 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-c5eea168-621b-48e5-88cb-a1aefd19cd72 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:44.239229 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c5eea168-621b-48e5-88cb-a1aefd19cd72 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:44.239436 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9c250d73-f74b-4952-80c9-0eb2d00ded8a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:44.239818 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9c250d73-f74b-4952-80c9-0eb2d00ded8a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:44.240544 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9c250d73-f74b-4952-80c9-0eb2d00ded8a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:44.241456 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9c250d73-f74b-4952-80c9-0eb2d00ded8a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:44.241921 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9c250d73-f74b-4952-80c9-0eb2d00ded8a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:44.242043 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c5eea168-621b-48e5-88cb-a1aefd19cd72 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:44.242427 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c5eea168-621b-48e5-88cb-a1aefd19cd72 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:44.242752 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9c250d73-f74b-4952-80c9-0eb2d00ded8a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:44.243153 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c5eea168-621b-48e5-88cb-a1aefd19cd72 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:44.243615 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c5eea168-621b-48e5-88cb-a1aefd19cd72 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:44.244354 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c5eea168-621b-48e5-88cb-a1aefd19cd72 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:44.877202 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c5eea168-621b-48e5-88cb-a1aefd19cd72 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:44.886268 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c5eea168-621b-48e5-88cb-a1aefd19cd72 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:44.887694 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c5eea168-621b-48e5-88cb-a1aefd19cd72 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:44.889208 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-c5eea168-621b-48e5-88cb-a1aefd19cd72 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1724 microversion: 2.20 time: 0.666286 Sep 01 16:41:44.890270 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 391/756] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:44 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1724 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:44.890667 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-9c250d73-f74b-4952-80c9-0eb2d00ded8a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:44.895042 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-de33068b-629d-45b2-b774-78a0fa4b14f6 req-7414707a-fb6b-459d-9cbb-7cf8cd389a76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd88a09b-04d0-4c19-b78e-cedce17f0956", "tag": "7796cb2a-2d4a-4d32-86e4-943b86e85759"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:44.900574 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9c250d73-f74b-4952-80c9-0eb2d00ded8a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956" status: 200 len: 1364 microversion: 2.1 time: 0.677385 Sep 01 16:41:44.901240 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 366/757] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:44 2022] GET /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956 => generated 1364 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:44.917420 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-de33068b-629d-45b2-b774-78a0fa4b14f6 req-7414707a-fb6b-459d-9cbb-7cf8cd389a76 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:44.918124 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-de33068b-629d-45b2-b774-78a0fa4b14f6 req-7414707a-fb6b-459d-9cbb-7cf8cd389a76 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:44.918702 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-de33068b-629d-45b2-b774-78a0fa4b14f6 req-7414707a-fb6b-459d-9cbb-7cf8cd389a76 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:44.931030 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-de33068b-629d-45b2-b774-78a0fa4b14f6 req-7414707a-fb6b-459d-9cbb-7cf8cd389a76 service nova] Creating event network-changed:7796cb2a-2d4a-4d32-86e4-943b86e85759 for instance cd88a09b-04d0-4c19-b78e-cedce17f0956 on hv-cinder-85221 Sep 01 16:41:44.936898 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-de33068b-629d-45b2-b774-78a0fa4b14f6 req-7414707a-fb6b-459d-9cbb-7cf8cd389a76 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045008 Sep 01 16:41:44.937253 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-265b9d4a-304b-4c3d-8b05-575a724cdbe7 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:44.937966 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-265b9d4a-304b-4c3d-8b05-575a724cdbe7 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:44.938379 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 392/758] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:44.945651 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-265b9d4a-304b-4c3d-8b05-575a724cdbe7 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:44.946268 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-265b9d4a-304b-4c3d-8b05-575a724cdbe7 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:44.946753 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-265b9d4a-304b-4c3d-8b05-575a724cdbe7 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:44.947465 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-265b9d4a-304b-4c3d-8b05-575a724cdbe7 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:44.948032 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-265b9d4a-304b-4c3d-8b05-575a724cdbe7 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:44.948775 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-265b9d4a-304b-4c3d-8b05-575a724cdbe7 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:45.114050 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-cb39cb13-977b-45c6-9f9f-8685b20a095c tempest-VolumesNegativeTest-487708809 tempest-VolumesNegativeTest-487708809-project] Action: 'create', calling method: .version_select at 0x7f948232a550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1867862058", "metadata": {"Type": "work"}}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:45.127640 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-cb39cb13-977b-45c6-9f9f-8685b20a095c tempest-VolumesNegativeTest-487708809 tempest-VolumesNegativeTest-487708809-project] Request method failure captured: Sep 01 16:41:45.127640 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 16:41:45.127640 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 01 16:41:45.127640 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 01 16:41:45.127640 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Connection: close Sep 01 16:41:45.127640 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Length: 122 Sep 01 16:41:45.127640 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 01 16:41:45.127640 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Host: 10.222.0.62 Sep 01 16:41:45.127640 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 01 16:41:45.127640 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 01 16:41:45.127640 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjEODI1TG_XD6Bg_ITbrSqGpbR0e0otdrJhabcNBXSch8x5ObGHP2C8NuErxQNpz6D1ZG7sHWj7w-UyiHZIJqYqEX0Z9yAW3awqfrNWWi7OPYrS5VXp5FIAUjWBqQYrmguB-NCHyka42zx6uOYUtBOuH1I--8rkAQ9ikKzBCAnfVUPdog Sep 01 16:41:45.127640 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 01 16:41:45.127640 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 01 16:41:45.127640 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 01 16:41:45.127640 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 01 16:41:45.127640 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 01 16:41:45.127640 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 01 16:41:45.127640 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Id: dc025fe8f2f944be83d8e52a94575238 Sep 01 16:41:45.127640 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-VolumesNegativeTest-487708809 Sep 01 16:41:45.127640 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 01 16:41:45.127640 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 01 16:41:45.129317 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/dc025fe8f2f944be83d8e52a94575238"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/dc025fe8f2f944be83d8e52a94575238"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_dc025fe8f2f944be83d8e52a94575238"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/dc025fe8f2f944be83d8e52a94575238"}]}] Sep 01 16:41:45.129317 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-VolumesNegativeTest-487708809 Sep 01 16:41:45.129317 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Id: dc025fe8f2f944be83d8e52a94575238 Sep 01 16:41:45.129317 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-VolumesNegativeTest-487708809 Sep 01 16:41:45.129317 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User: tempest-VolumesNegativeTest-487708809-project Sep 01 16:41:45.129317 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 01 16:41:45.129317 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 01 16:41:45.129317 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Id: 0e46ac7f2c8343a0a81a9a9dca1b0d22 Sep 01 16:41:45.129317 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-VolumesNegativeTest-487708809-project Sep 01 16:41:45.129317 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Sep 01 16:41:45.129317 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1867862058", "metadata": {"Type": "work"}}} Sep 01 16:41:45.129317 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: method: Sep 01 16:41:45.129317 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 16:41:45.130253 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1867862058', 'metadata': {'Type': 'work'}}}} Sep 01 16:41:45.130253 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:41:45.130253 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:45.130253 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 16:41:45.130253 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 16:41:45.130253 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 16:41:45.130253 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise error Sep 01 16:41:45.130253 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 01 16:41:45.130253 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:45.130253 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 01 16:41:45.130253 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 16:41:45.130253 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:45.130253 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 16:41:45.130253 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi '#$%' Sep 01 16:41:45.130253 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:45.130253 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:45.130253 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:45.130253 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:45.130253 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:45.130253 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:45.130253 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:41:45.130253 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:41:45.131878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 16:41:45.131878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 16:41:45.131878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:41:45.131878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:41:45.131878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 16:41:45.131878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 16:41:45.131878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 16:41:45.131878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 16:41:45.131878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 16:41:45.131878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 16:41:45.131878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 16:41:45.131878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:45.131878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:45.131878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:45.131878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:45.131878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:45.131878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:45.131878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 16:41:45.131878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 16:41:45.133291 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 16:41:45.133291 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:45.133291 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-cb39cb13-977b-45c6-9f9f-8685b20a095c tempest-VolumesNegativeTest-487708809 tempest-VolumesNegativeTest-487708809-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:41:45.133291 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-cb39cb13-977b-45c6-9f9f-8685b20a095c tempest-VolumesNegativeTest-487708809 tempest-VolumesNegativeTest-487708809-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.141604 Sep 01 16:41:45.133291 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 393/759] 10.222.0.62 () {60 vars in 1156 bytes} [Thu Sep 1 16:41:44 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 143 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 16:41:45.140755 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-48499b2f-2e6b-453e-98d0-cb924239a744 tempest-VolumesNegativeTest-487708809 tempest-VolumesNegativeTest-487708809-project] Action: 'create', calling method: .version_select at 0x7f94822d5ee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-195430187", "metadata": {"Type": "work"}}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:45.144915 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-48499b2f-2e6b-453e-98d0-cb924239a744 tempest-VolumesNegativeTest-487708809 tempest-VolumesNegativeTest-487708809-project] Request method failure captured: Sep 01 16:41:45.144915 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 16:41:45.144915 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 01 16:41:45.144915 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 01 16:41:45.144915 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Connection: close Sep 01 16:41:45.144915 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Length: 119 Sep 01 16:41:45.144915 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 01 16:41:45.144915 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Host: 10.222.0.62 Sep 01 16:41:45.144915 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 01 16:41:45.144915 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 01 16:41:45.144915 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjEODI1TG_XD6Bg_ITbrSqGpbR0e0otdrJhabcNBXSch8x5ObGHP2C8NuErxQNpz6D1ZG7sHWj7w-UyiHZIJqYqEX0Z9yAW3awqfrNWWi7OPYrS5VXp5FIAUjWBqQYrmguB-NCHyka42zx6uOYUtBOuH1I--8rkAQ9ikKzBCAnfVUPdog Sep 01 16:41:45.144915 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 01 16:41:45.144915 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 01 16:41:45.144915 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 01 16:41:45.144915 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 01 16:41:45.144915 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 01 16:41:45.144915 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 01 16:41:45.144915 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Id: dc025fe8f2f944be83d8e52a94575238 Sep 01 16:41:45.144915 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-VolumesNegativeTest-487708809 Sep 01 16:41:45.144915 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 01 16:41:45.144915 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 01 16:41:45.148344 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/dc025fe8f2f944be83d8e52a94575238"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/dc025fe8f2f944be83d8e52a94575238"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_dc025fe8f2f944be83d8e52a94575238"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/dc025fe8f2f944be83d8e52a94575238"}]}] Sep 01 16:41:45.148344 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-VolumesNegativeTest-487708809 Sep 01 16:41:45.148344 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Id: dc025fe8f2f944be83d8e52a94575238 Sep 01 16:41:45.148344 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-VolumesNegativeTest-487708809 Sep 01 16:41:45.148344 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User: tempest-VolumesNegativeTest-487708809-project Sep 01 16:41:45.148344 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 01 16:41:45.148344 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 01 16:41:45.148344 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Id: 0e46ac7f2c8343a0a81a9a9dca1b0d22 Sep 01 16:41:45.148344 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-VolumesNegativeTest-487708809-project Sep 01 16:41:45.148344 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Sep 01 16:41:45.148344 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-195430187", "metadata": {"Type": "work"}}} Sep 01 16:41:45.148344 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: method: Sep 01 16:41:45.148344 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 16:41:45.149982 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-195430187', 'metadata': {'Type': 'work'}}}} Sep 01 16:41:45.149982 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:41:45.149982 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:45.149982 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 16:41:45.149982 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 16:41:45.149982 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 16:41:45.149982 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise error Sep 01 16:41:45.149982 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 01 16:41:45.149982 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:45.149982 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 01 16:41:45.149982 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 16:41:45.149982 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:45.149982 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 16:41:45.149982 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi '0' Sep 01 16:41:45.149982 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:45.149982 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:45.149982 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:45.149982 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:45.149982 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:45.149982 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:45.149982 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:41:45.149982 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:41:45.151371 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 16:41:45.151371 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 16:41:45.151371 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:41:45.151371 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:41:45.151371 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 16:41:45.151371 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 16:41:45.151371 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 16:41:45.151371 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 16:41:45.151371 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 16:41:45.151371 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 16:41:45.151371 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 16:41:45.151371 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:45.151371 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:45.151371 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:45.151371 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:45.151371 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:45.151371 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:45.151371 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 16:41:45.151371 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 16:41:45.154399 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 16:41:45.154399 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:45.154399 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-48499b2f-2e6b-453e-98d0-cb924239a744 tempest-VolumesNegativeTest-487708809 tempest-VolumesNegativeTest-487708809-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:41:45.154399 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-48499b2f-2e6b-453e-98d0-cb924239a744 tempest-VolumesNegativeTest-487708809 tempest-VolumesNegativeTest-487708809-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010463 Sep 01 16:41:45.154399 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 394/760] 10.222.0.62 () {60 vars in 1156 bytes} [Thu Sep 1 16:41:45 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 01 16:41:45.156871 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-972188ed-efdd-4338-992f-92550780a1b9 tempest-VolumesNegativeTest-487708809 tempest-VolumesNegativeTest-487708809-project] Action: 'create', calling method: .version_select at 0x7f948384b700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-837244456", "metadata": {"Type": "work"}}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:45.160386 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-972188ed-efdd-4338-992f-92550780a1b9 tempest-VolumesNegativeTest-487708809 tempest-VolumesNegativeTest-487708809-project] Request method failure captured: Sep 01 16:41:45.160386 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 16:41:45.160386 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 01 16:41:45.160386 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 01 16:41:45.160386 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Connection: close Sep 01 16:41:45.160386 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Length: 118 Sep 01 16:41:45.160386 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 01 16:41:45.160386 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Host: 10.222.0.62 Sep 01 16:41:45.160386 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 01 16:41:45.160386 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 01 16:41:45.160386 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjEODI1TG_XD6Bg_ITbrSqGpbR0e0otdrJhabcNBXSch8x5ObGHP2C8NuErxQNpz6D1ZG7sHWj7w-UyiHZIJqYqEX0Z9yAW3awqfrNWWi7OPYrS5VXp5FIAUjWBqQYrmguB-NCHyka42zx6uOYUtBOuH1I--8rkAQ9ikKzBCAnfVUPdog Sep 01 16:41:45.160386 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 01 16:41:45.160386 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 01 16:41:45.160386 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 01 16:41:45.160386 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 01 16:41:45.160386 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 01 16:41:45.160386 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 01 16:41:45.160386 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Id: dc025fe8f2f944be83d8e52a94575238 Sep 01 16:41:45.160386 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-VolumesNegativeTest-487708809 Sep 01 16:41:45.160386 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 01 16:41:45.160386 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 01 16:41:45.163196 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/dc025fe8f2f944be83d8e52a94575238"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/dc025fe8f2f944be83d8e52a94575238"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_dc025fe8f2f944be83d8e52a94575238"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/dc025fe8f2f944be83d8e52a94575238"}]}] Sep 01 16:41:45.163196 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-VolumesNegativeTest-487708809 Sep 01 16:41:45.163196 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Id: dc025fe8f2f944be83d8e52a94575238 Sep 01 16:41:45.163196 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-VolumesNegativeTest-487708809 Sep 01 16:41:45.163196 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User: tempest-VolumesNegativeTest-487708809-project Sep 01 16:41:45.163196 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 01 16:41:45.163196 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 01 16:41:45.163196 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Id: 0e46ac7f2c8343a0a81a9a9dca1b0d22 Sep 01 16:41:45.163196 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-VolumesNegativeTest-487708809-project Sep 01 16:41:45.163196 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Sep 01 16:41:45.163196 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-837244456", "metadata": {"Type": "work"}}} Sep 01 16:41:45.163196 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: method: Sep 01 16:41:45.163196 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 16:41:45.164707 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-837244456', 'metadata': {'Type': 'work'}}}} Sep 01 16:41:45.164707 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:41:45.164707 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:45.164707 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 16:41:45.164707 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 16:41:45.164707 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 16:41:45.164707 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise error Sep 01 16:41:45.164707 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 01 16:41:45.164707 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:45.164707 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 01 16:41:45.164707 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 16:41:45.164707 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:45.164707 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 16:41:45.164707 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi '' Sep 01 16:41:45.164707 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:45.164707 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:45.164707 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:45.164707 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:45.164707 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:45.164707 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:45.164707 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:41:45.164707 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:41:45.166845 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 16:41:45.166845 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 16:41:45.166845 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:41:45.166845 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:41:45.166845 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 16:41:45.166845 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 16:41:45.166845 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 16:41:45.166845 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 16:41:45.166845 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 16:41:45.166845 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 16:41:45.166845 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 16:41:45.166845 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:45.166845 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:45.166845 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:45.166845 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:45.166845 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:45.166845 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:45.166845 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 16:41:45.166845 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 16:41:45.169140 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 16:41:45.169140 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:45.169140 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-972188ed-efdd-4338-992f-92550780a1b9 tempest-VolumesNegativeTest-487708809 tempest-VolumesNegativeTest-487708809-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:41:45.169140 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-972188ed-efdd-4338-992f-92550780a1b9 tempest-VolumesNegativeTest-487708809 tempest-VolumesNegativeTest-487708809-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008561 Sep 01 16:41:45.169140 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 395/761] 10.222.0.62 () {60 vars in 1156 bytes} [Thu Sep 1 16:41:45 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 16:41:45.171108 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-6d00e555-091b-4536-9991-3bd6850e48a6 tempest-VolumesNegativeTest-487708809 tempest-VolumesNegativeTest-487708809-project] Calling method '.version_select at 0x7f948232aaf0>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:45.181814 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-265b9d4a-304b-4c3d-8b05-575a724cdbe7 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:45.190393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-265b9d4a-304b-4c3d-8b05-575a724cdbe7 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1562 microversion: 2.1 time: 0.260533 Sep 01 16:41:45.191925 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 367/762] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:44 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1562 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:41:45.201691 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-6d00e555-091b-4536-9991-3bd6850e48a6 tempest-VolumesNegativeTest-487708809 tempest-VolumesNegativeTest-487708809-project] HTTP exception thrown: Volume tempest-invalid-207931161 could not be found. Sep 01 16:41:45.203644 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-6d00e555-091b-4536-9991-3bd6850e48a6 tempest-VolumesNegativeTest-487708809 tempest-VolumesNegativeTest-487708809-project] Request method failure captured: Sep 01 16:41:45.203644 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-207931161 HTTP/1.1 Sep 01 16:41:45.203644 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 01 16:41:45.203644 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 01 16:41:45.203644 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Connection: close Sep 01 16:41:45.203644 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 01 16:41:45.203644 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 01 16:41:45.203644 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Host: 10.222.0.62 Sep 01 16:41:45.203644 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 01 16:41:45.203644 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 01 16:41:45.203644 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjEODI1TG_XD6Bg_ITbrSqGpbR0e0otdrJhabcNBXSch8x5ObGHP2C8NuErxQNpz6D1ZG7sHWj7w-UyiHZIJqYqEX0Z9yAW3awqfrNWWi7OPYrS5VXp5FIAUjWBqQYrmguB-NCHyka42zx6uOYUtBOuH1I--8rkAQ9ikKzBCAnfVUPdog Sep 01 16:41:45.203644 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 01 16:41:45.203644 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 01 16:41:45.203644 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 01 16:41:45.203644 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 01 16:41:45.203644 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 01 16:41:45.203644 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 01 16:41:45.203644 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Id: dc025fe8f2f944be83d8e52a94575238 Sep 01 16:41:45.203644 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-VolumesNegativeTest-487708809 Sep 01 16:41:45.203644 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 01 16:41:45.203644 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 01 16:41:45.204935 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/dc025fe8f2f944be83d8e52a94575238"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/dc025fe8f2f944be83d8e52a94575238"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_dc025fe8f2f944be83d8e52a94575238"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/dc025fe8f2f944be83d8e52a94575238"}]}] Sep 01 16:41:45.204935 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-VolumesNegativeTest-487708809 Sep 01 16:41:45.204935 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Id: dc025fe8f2f944be83d8e52a94575238 Sep 01 16:41:45.204935 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-VolumesNegativeTest-487708809 Sep 01 16:41:45.204935 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User: tempest-VolumesNegativeTest-487708809-project Sep 01 16:41:45.204935 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 01 16:41:45.204935 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 01 16:41:45.204935 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Id: 0e46ac7f2c8343a0a81a9a9dca1b0d22 Sep 01 16:41:45.204935 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-VolumesNegativeTest-487708809-project Sep 01 16:41:45.204935 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: method: Sep 01 16:41:45.204935 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: exception: Volume tempest-invalid-207931161 could not be found. Sep 01 16:41:45.204935 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: action_args: {'id': 'tempest-invalid-207931161'} Sep 01 16:41:45.204935 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:41:45.205734 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:45.205734 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:41:45.205734 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:41:45.205734 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 16:41:45.205734 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 16:41:45.205734 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 16:41:45.205734 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 16:41:45.205734 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 16:41:45.205734 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 16:41:45.205734 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 16:41:45.205734 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 16:41:45.205734 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:41:45.205734 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:41:45.205734 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:41:45.205734 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:41:45.205734 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-207931161 could not be found. (HTTP 404) (Request-ID: req-2ed6956e-c33a-4325-9fc7-c4de448cfc06) Sep 01 16:41:45.205734 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:45.205734 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:45.205734 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:45.207958 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:45.207958 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 16:41:45.207958 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 16:41:45.207958 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 16:41:45.207958 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 16:41:45.207958 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 16:41:45.207958 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 16:41:45.207958 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 16:41:45.207958 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 16:41:45.207958 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:41:45.207958 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:41:45.207958 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 16:41:45.207958 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 16:41:45.207958 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 16:41:45.207958 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 16:41:45.207958 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 16:41:45.207958 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 16:41:45.207958 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 16:41:45.207958 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 16:41:45.209600 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:41:45.209600 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:41:45.209600 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:41:45.209600 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:41:45.209600 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-207931161 could not be found. Sep 01 16:41:45.209600 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:45.209600 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:45.209600 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:45.209600 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:45.209600 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:45.209600 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:45.209600 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:41:45.209600 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:41:45.209600 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 16:41:45.209600 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 16:41:45.209600 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:41:45.209600 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:41:45.209600 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 16:41:45.209600 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:41:45.209600 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-207931161 could not be found. Sep 01 16:41:45.210980 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:45.210980 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:45.210980 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:45.210980 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:45.210980 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:45.210980 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:45.210980 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:41:45.210980 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:41:45.210980 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-207931161 could not be found. Sep 01 16:41:45.210980 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:45.210980 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-6d00e555-091b-4536-9991-3bd6850e48a6 tempest-VolumesNegativeTest-487708809 tempest-VolumesNegativeTest-487708809-project] Returning 404 to user: Volume tempest-invalid-207931161 could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:41:45.210980 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-6d00e555-091b-4536-9991-3bd6850e48a6 tempest-VolumesNegativeTest-487708809 tempest-VolumesNegativeTest-487708809-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/tempest-invalid-207931161" status: 404 len: 98 microversion: 2.1 time: 0.037561 Sep 01 16:41:45.210980 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 396/763] 10.222.0.62 () {58 vars in 1215 bytes} [Thu Sep 1 16:41:45 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-207931161 => generated 98 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 16:41:45.217805 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-caa0bd43-6a5b-43ac-ac02-a307335b2d40 tempest-VolumesNegativeTest-487708809 tempest-VolumesNegativeTest-487708809-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003793 Sep 01 16:41:45.218303 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 368/764] 10.222.0.62 () {58 vars in 1140 bytes} [Thu Sep 1 16:41:45 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 01 16:41:45.229213 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8da0d4a0-220f-42f1-88a1-41be4f582ad9 tempest-VolumesNegativeTest-487708809 tempest-VolumesNegativeTest-487708809-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004072 Sep 01 16:41:45.229774 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 397/765] 10.222.0.62 () {58 vars in 1137 bytes} [Thu Sep 1 16:41:45 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 01 16:41:45.239184 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5b739d8d-c26c-4f68-b809-9004f112a0b5 tempest-VolumesNegativeTest-487708809 tempest-VolumesNegativeTest-487708809-project] Calling method '.version_select at 0x7f94822a48b0>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:45.269194 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-5b739d8d-c26c-4f68-b809-9004f112a0b5 tempest-VolumesNegativeTest-487708809 tempest-VolumesNegativeTest-487708809-project] HTTP exception thrown: Volume 325a128a-dd2b-4016-a37c-8629d5e527ac could not be found. Sep 01 16:41:45.271193 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5b739d8d-c26c-4f68-b809-9004f112a0b5 tempest-VolumesNegativeTest-487708809 tempest-VolumesNegativeTest-487708809-project] Request method failure captured: Sep 01 16:41:45.271193 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: request: DELETE /compute/v2.1/os-volumes/325a128a-dd2b-4016-a37c-8629d5e527ac HTTP/1.1 Sep 01 16:41:45.271193 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 01 16:41:45.271193 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 01 16:41:45.271193 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Connection: close Sep 01 16:41:45.271193 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 01 16:41:45.271193 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 01 16:41:45.271193 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Host: 10.222.0.62 Sep 01 16:41:45.271193 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 01 16:41:45.271193 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 01 16:41:45.271193 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjEODI1TG_XD6Bg_ITbrSqGpbR0e0otdrJhabcNBXSch8x5ObGHP2C8NuErxQNpz6D1ZG7sHWj7w-UyiHZIJqYqEX0Z9yAW3awqfrNWWi7OPYrS5VXp5FIAUjWBqQYrmguB-NCHyka42zx6uOYUtBOuH1I--8rkAQ9ikKzBCAnfVUPdog Sep 01 16:41:45.271193 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 01 16:41:45.271193 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 01 16:41:45.271193 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 01 16:41:45.271193 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 01 16:41:45.271193 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 01 16:41:45.271193 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 01 16:41:45.271193 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Id: dc025fe8f2f944be83d8e52a94575238 Sep 01 16:41:45.271193 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-VolumesNegativeTest-487708809 Sep 01 16:41:45.271193 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 01 16:41:45.271193 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 01 16:41:45.273023 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/dc025fe8f2f944be83d8e52a94575238"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/dc025fe8f2f944be83d8e52a94575238"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_dc025fe8f2f944be83d8e52a94575238"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/dc025fe8f2f944be83d8e52a94575238"}]}] Sep 01 16:41:45.273023 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-VolumesNegativeTest-487708809 Sep 01 16:41:45.273023 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Id: dc025fe8f2f944be83d8e52a94575238 Sep 01 16:41:45.273023 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-VolumesNegativeTest-487708809 Sep 01 16:41:45.273023 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User: tempest-VolumesNegativeTest-487708809-project Sep 01 16:41:45.273023 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 01 16:41:45.273023 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 01 16:41:45.273023 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Id: 0e46ac7f2c8343a0a81a9a9dca1b0d22 Sep 01 16:41:45.273023 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-VolumesNegativeTest-487708809-project Sep 01 16:41:45.273023 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: method: Sep 01 16:41:45.273023 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: exception: Volume 325a128a-dd2b-4016-a37c-8629d5e527ac could not be found. Sep 01 16:41:45.273023 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: action_args: {'id': '325a128a-dd2b-4016-a37c-8629d5e527ac'} Sep 01 16:41:45.273023 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:41:45.273932 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:45.273932 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:41:45.273932 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:41:45.273932 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 16:41:45.273932 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 16:41:45.273932 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 16:41:45.273932 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 16:41:45.273932 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 16:41:45.273932 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 16:41:45.273932 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 16:41:45.273932 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 16:41:45.273932 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:41:45.273932 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:41:45.273932 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:41:45.273932 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:41:45.273932 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 325a128a-dd2b-4016-a37c-8629d5e527ac could not be found. (HTTP 404) (Request-ID: req-7733bf1e-685a-44a6-9cb5-26f6d5fa52fd) Sep 01 16:41:45.273932 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:41:45.273932 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:45.273932 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:41:45.275391 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:45.275391 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 16:41:45.275391 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 16:41:45.275391 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 16:41:45.275391 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 16:41:45.275391 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 16:41:45.275391 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 16:41:45.275391 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 16:41:45.275391 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 16:41:45.275391 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:41:45.275391 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:41:45.275391 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 16:41:45.275391 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 16:41:45.275391 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 16:41:45.275391 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 16:41:45.275391 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 16:41:45.275391 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 16:41:45.275391 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 16:41:45.275391 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 16:41:45.276730 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:41:45.276730 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:41:45.276730 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:41:45.276730 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:41:45.276730 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 325a128a-dd2b-4016-a37c-8629d5e527ac could not be found. Sep 01 16:41:45.276730 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:41:45.276730 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:45.276730 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:41:45.276730 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:45.276730 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:45.276730 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:45.276730 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:41:45.276730 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:41:45.276730 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 16:41:45.276730 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 16:41:45.276730 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:41:45.276730 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:41:45.276730 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 16:41:45.276730 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:41:45.278072 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 325a128a-dd2b-4016-a37c-8629d5e527ac could not be found. Sep 01 16:41:45.278072 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:41:45.278072 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:45.278072 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:41:45.278072 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:45.278072 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:45.278072 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:45.278072 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:41:45.278072 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:41:45.278072 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 325a128a-dd2b-4016-a37c-8629d5e527ac could not be found. Sep 01 16:41:45.278072 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:41:45.278072 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5b739d8d-c26c-4f68-b809-9004f112a0b5 tempest-VolumesNegativeTest-487708809 tempest-VolumesNegativeTest-487708809-project] Returning 404 to user: Volume 325a128a-dd2b-4016-a37c-8629d5e527ac could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:41:45.278072 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5b739d8d-c26c-4f68-b809-9004f112a0b5 tempest-VolumesNegativeTest-487708809 tempest-VolumesNegativeTest-487708809-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/325a128a-dd2b-4016-a37c-8629d5e527ac" status: 404 len: 109 microversion: 2.1 time: 0.037828 Sep 01 16:41:45.278072 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 369/766] 10.222.0.62 () {58 vars in 1248 bytes} [Thu Sep 1 16:41:45 2022] DELETE /compute/v2.1/os-volumes/325a128a-dd2b-4016-a37c-8629d5e527ac => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:41:45.282980 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0effef01-8ed5-470e-ac5d-7c64ec649eed tempest-VolumesNegativeTest-487708809 tempest-VolumesNegativeTest-487708809-project] Calling method '.version_select at 0x7f948275b550>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:45.319715 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-0effef01-8ed5-470e-ac5d-7c64ec649eed tempest-VolumesNegativeTest-487708809 tempest-VolumesNegativeTest-487708809-project] HTTP exception thrown: Volume 7f35502b-d4c0-4ea5-be3d-006c97af3305 could not be found. Sep 01 16:41:45.322316 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0effef01-8ed5-470e-ac5d-7c64ec649eed tempest-VolumesNegativeTest-487708809 tempest-VolumesNegativeTest-487708809-project] Request method failure captured: Sep 01 16:41:45.322316 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: request: GET /compute/v2.1/os-volumes/7f35502b-d4c0-4ea5-be3d-006c97af3305 HTTP/1.1 Sep 01 16:41:45.322316 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 01 16:41:45.322316 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 01 16:41:45.322316 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Connection: close Sep 01 16:41:45.322316 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 01 16:41:45.322316 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 01 16:41:45.322316 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Host: 10.222.0.62 Sep 01 16:41:45.322316 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 01 16:41:45.322316 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 01 16:41:45.322316 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjEODI1TG_XD6Bg_ITbrSqGpbR0e0otdrJhabcNBXSch8x5ObGHP2C8NuErxQNpz6D1ZG7sHWj7w-UyiHZIJqYqEX0Z9yAW3awqfrNWWi7OPYrS5VXp5FIAUjWBqQYrmguB-NCHyka42zx6uOYUtBOuH1I--8rkAQ9ikKzBCAnfVUPdog Sep 01 16:41:45.322316 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 01 16:41:45.322316 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 01 16:41:45.322316 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 01 16:41:45.322316 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 01 16:41:45.322316 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 01 16:41:45.322316 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 01 16:41:45.322316 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Id: dc025fe8f2f944be83d8e52a94575238 Sep 01 16:41:45.322316 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-VolumesNegativeTest-487708809 Sep 01 16:41:45.322316 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 01 16:41:45.322316 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 01 16:41:45.324135 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/dc025fe8f2f944be83d8e52a94575238"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/dc025fe8f2f944be83d8e52a94575238"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_dc025fe8f2f944be83d8e52a94575238"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/dc025fe8f2f944be83d8e52a94575238"}]}] Sep 01 16:41:45.324135 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-VolumesNegativeTest-487708809 Sep 01 16:41:45.324135 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Id: dc025fe8f2f944be83d8e52a94575238 Sep 01 16:41:45.324135 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-VolumesNegativeTest-487708809 Sep 01 16:41:45.324135 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User: tempest-VolumesNegativeTest-487708809-project Sep 01 16:41:45.324135 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 01 16:41:45.324135 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 01 16:41:45.324135 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Id: 0e46ac7f2c8343a0a81a9a9dca1b0d22 Sep 01 16:41:45.324135 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-VolumesNegativeTest-487708809-project Sep 01 16:41:45.324135 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: method: Sep 01 16:41:45.324135 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: exception: Volume 7f35502b-d4c0-4ea5-be3d-006c97af3305 could not be found. Sep 01 16:41:45.324135 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: action_args: {'id': '7f35502b-d4c0-4ea5-be3d-006c97af3305'} Sep 01 16:41:45.324135 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:41:45.325022 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:45.325022 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:41:45.325022 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:41:45.325022 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 16:41:45.325022 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 16:41:45.325022 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 16:41:45.325022 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 16:41:45.325022 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 16:41:45.325022 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 16:41:45.325022 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 16:41:45.325022 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 16:41:45.325022 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:41:45.325022 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:41:45.325022 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:41:45.325022 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:41:45.325022 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7f35502b-d4c0-4ea5-be3d-006c97af3305 could not be found. (HTTP 404) (Request-ID: req-eac4ec1e-40f1-4a34-8821-dde47a2d7ebb) Sep 01 16:41:45.325022 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:45.325022 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:45.325022 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:45.326308 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:45.326308 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 16:41:45.326308 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 16:41:45.326308 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 16:41:45.326308 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 16:41:45.326308 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 16:41:45.326308 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 16:41:45.326308 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 16:41:45.326308 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 16:41:45.326308 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:41:45.326308 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:41:45.326308 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 16:41:45.326308 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 16:41:45.326308 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 16:41:45.326308 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 16:41:45.326308 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 16:41:45.326308 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 16:41:45.326308 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 16:41:45.326308 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 16:41:45.327593 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:41:45.327593 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:41:45.327593 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:41:45.327593 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:41:45.327593 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7f35502b-d4c0-4ea5-be3d-006c97af3305 could not be found. Sep 01 16:41:45.327593 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:45.327593 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:45.327593 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:45.327593 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:45.327593 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:45.327593 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:45.327593 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:41:45.327593 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:41:45.327593 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 16:41:45.327593 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 16:41:45.327593 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:41:45.327593 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:41:45.327593 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 16:41:45.327593 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:41:45.328984 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7f35502b-d4c0-4ea5-be3d-006c97af3305 could not be found. Sep 01 16:41:45.328984 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:45.328984 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:45.328984 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:45.328984 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:45.328984 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:45.328984 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:45.328984 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:41:45.328984 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:41:45.328984 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7f35502b-d4c0-4ea5-be3d-006c97af3305 could not be found. Sep 01 16:41:45.328984 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:41:45.328984 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0effef01-8ed5-470e-ac5d-7c64ec649eed tempest-VolumesNegativeTest-487708809 tempest-VolumesNegativeTest-487708809-project] Returning 404 to user: Volume 7f35502b-d4c0-4ea5-be3d-006c97af3305 could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:41:45.328984 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-0effef01-8ed5-470e-ac5d-7c64ec649eed tempest-VolumesNegativeTest-487708809 tempest-VolumesNegativeTest-487708809-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/7f35502b-d4c0-4ea5-be3d-006c97af3305" status: 404 len: 109 microversion: 2.1 time: 0.045471 Sep 01 16:41:45.328984 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 398/767] 10.222.0.62 () {58 vars in 1245 bytes} [Thu Sep 1 16:41:45 2022] GET /compute/v2.1/os-volumes/7f35502b-d4c0-4ea5-be3d-006c97af3305 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:41:45.913462 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-4dbd1603-4a5f-446c-904f-1ce8d55e9f8d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:45.914071 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-4dbd1603-4a5f-446c-904f-1ce8d55e9f8d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:45.923018 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-cd6f9cb7-9ff0-4024-ae0b-340e9518f926 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:45.923747 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-cd6f9cb7-9ff0-4024-ae0b-340e9518f926 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: cd88a09b-04d0-4c19-b78e-cedce17f0956] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:45.930824 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cd6f9cb7-9ff0-4024-ae0b-340e9518f926 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:45.931321 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cd6f9cb7-9ff0-4024-ae0b-340e9518f926 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:45.931489 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4dbd1603-4a5f-446c-904f-1ce8d55e9f8d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:45.931764 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cd6f9cb7-9ff0-4024-ae0b-340e9518f926 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:45.932441 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4dbd1603-4a5f-446c-904f-1ce8d55e9f8d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:45.932807 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cd6f9cb7-9ff0-4024-ae0b-340e9518f926 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:45.932943 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4dbd1603-4a5f-446c-904f-1ce8d55e9f8d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:45.933385 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cd6f9cb7-9ff0-4024-ae0b-340e9518f926 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:45.933542 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4dbd1603-4a5f-446c-904f-1ce8d55e9f8d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:45.933835 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cd6f9cb7-9ff0-4024-ae0b-340e9518f926 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:45.933992 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4dbd1603-4a5f-446c-904f-1ce8d55e9f8d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:45.934613 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4dbd1603-4a5f-446c-904f-1ce8d55e9f8d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:46.195608 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-4dbd1603-4a5f-446c-904f-1ce8d55e9f8d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:46.206082 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-4dbd1603-4a5f-446c-904f-1ce8d55e9f8d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:46.207987 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-4dbd1603-4a5f-446c-904f-1ce8d55e9f8d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:46.209678 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-4dbd1603-4a5f-446c-904f-1ce8d55e9f8d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1724 microversion: 2.20 time: 0.300492 Sep 01 16:41:46.211172 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 370/768] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:45 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1724 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:46.237378 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-cd6f9cb7-9ff0-4024-ae0b-340e9518f926 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:46.246279 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-cd6f9cb7-9ff0-4024-ae0b-340e9518f926 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956" status: 200 len: 1364 microversion: 2.1 time: 0.327351 Sep 01 16:41:46.247957 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 399/769] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:45 2022] GET /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956 => generated 1364 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:47.235000 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-edff07dc-fb9c-4f44-b768-af3d716477ef tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:47.235607 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-edff07dc-fb9c-4f44-b768-af3d716477ef tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:47.243175 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-edff07dc-fb9c-4f44-b768-af3d716477ef tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:47.243869 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-edff07dc-fb9c-4f44-b768-af3d716477ef tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:47.244697 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-edff07dc-fb9c-4f44-b768-af3d716477ef tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:47.245776 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-edff07dc-fb9c-4f44-b768-af3d716477ef tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:47.246465 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-edff07dc-fb9c-4f44-b768-af3d716477ef tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:47.247078 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-edff07dc-fb9c-4f44-b768-af3d716477ef tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:47.267253 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0bdcf027-bab4-4287-84f9-862f1323d517 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:47.267842 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-0bdcf027-bab4-4287-84f9-862f1323d517 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: cd88a09b-04d0-4c19-b78e-cedce17f0956] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:47.275268 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0bdcf027-bab4-4287-84f9-862f1323d517 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:47.276088 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0bdcf027-bab4-4287-84f9-862f1323d517 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:47.276615 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0bdcf027-bab4-4287-84f9-862f1323d517 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:47.277488 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0bdcf027-bab4-4287-84f9-862f1323d517 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:47.278189 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0bdcf027-bab4-4287-84f9-862f1323d517 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:47.278898 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0bdcf027-bab4-4287-84f9-862f1323d517 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:47.452337 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-edff07dc-fb9c-4f44-b768-af3d716477ef tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:47.461220 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-edff07dc-fb9c-4f44-b768-af3d716477ef tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:47.462668 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-edff07dc-fb9c-4f44-b768-af3d716477ef tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:47.464146 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-edff07dc-fb9c-4f44-b768-af3d716477ef tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1724 microversion: 2.20 time: 0.234102 Sep 01 16:41:47.479979 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 371/770] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:47 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:47.483304 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-0bdcf027-bab4-4287-84f9-862f1323d517 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:47.491020 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-0bdcf027-bab4-4287-84f9-862f1323d517 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956" status: 200 len: 1364 microversion: 2.1 time: 0.228025 Sep 01 16:41:47.491631 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 400/771] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:47 2022] GET /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956 => generated 1364 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:48.489458 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b436b97a-fe8d-4f35-98c9-5c8044dad855 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:48.490052 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b436b97a-fe8d-4f35-98c9-5c8044dad855 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:48.496647 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b436b97a-fe8d-4f35-98c9-5c8044dad855 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:48.497364 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b436b97a-fe8d-4f35-98c9-5c8044dad855 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:48.497901 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b436b97a-fe8d-4f35-98c9-5c8044dad855 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:48.498738 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b436b97a-fe8d-4f35-98c9-5c8044dad855 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:48.500488 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b436b97a-fe8d-4f35-98c9-5c8044dad855 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:48.500933 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b436b97a-fe8d-4f35-98c9-5c8044dad855 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:48.512044 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-f35af04f-eadf-4cf8-9599-bbf65fe40082 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:48.513367 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-f35af04f-eadf-4cf8-9599-bbf65fe40082 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: cd88a09b-04d0-4c19-b78e-cedce17f0956] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:48.520400 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:48.522167 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f35af04f-eadf-4cf8-9599-bbf65fe40082 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:48.522837 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f35af04f-eadf-4cf8-9599-bbf65fe40082 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:48.523688 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f35af04f-eadf-4cf8-9599-bbf65fe40082 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:48.524630 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f35af04f-eadf-4cf8-9599-bbf65fe40082 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:48.525232 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f35af04f-eadf-4cf8-9599-bbf65fe40082 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:48.525790 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f35af04f-eadf-4cf8-9599-bbf65fe40082 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:48.702830 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b436b97a-fe8d-4f35-98c9-5c8044dad855 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:48.713063 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b436b97a-fe8d-4f35-98c9-5c8044dad855 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:48.714637 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b436b97a-fe8d-4f35-98c9-5c8044dad855 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:48.716044 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b436b97a-fe8d-4f35-98c9-5c8044dad855 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1724 microversion: 2.20 time: 0.230411 Sep 01 16:41:48.716682 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 372/772] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:48 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:48.768846 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-f35af04f-eadf-4cf8-9599-bbf65fe40082 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:48.777357 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-f35af04f-eadf-4cf8-9599-bbf65fe40082 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956" status: 200 len: 1364 microversion: 2.1 time: 0.269254 Sep 01 16:41:48.777999 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 401/773] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:48 2022] GET /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956 => generated 1364 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:49.739786 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c27d17da-2108-4b3b-8efe-8494a6adadb1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:49.740534 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c27d17da-2108-4b3b-8efe-8494a6adadb1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:49.747285 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c27d17da-2108-4b3b-8efe-8494a6adadb1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:49.747767 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c27d17da-2108-4b3b-8efe-8494a6adadb1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:49.748228 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c27d17da-2108-4b3b-8efe-8494a6adadb1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:49.748917 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c27d17da-2108-4b3b-8efe-8494a6adadb1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:49.749367 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c27d17da-2108-4b3b-8efe-8494a6adadb1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:49.749782 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c27d17da-2108-4b3b-8efe-8494a6adadb1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:49.798739 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-18f88422-3da7-4a83-a7e2-b38aea3e6546 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:49.800173 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-18f88422-3da7-4a83-a7e2-b38aea3e6546 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: cd88a09b-04d0-4c19-b78e-cedce17f0956] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:49.807709 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-18f88422-3da7-4a83-a7e2-b38aea3e6546 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:49.808224 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-18f88422-3da7-4a83-a7e2-b38aea3e6546 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:49.808644 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-18f88422-3da7-4a83-a7e2-b38aea3e6546 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:49.809331 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-18f88422-3da7-4a83-a7e2-b38aea3e6546 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:49.809772 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-18f88422-3da7-4a83-a7e2-b38aea3e6546 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:49.810184 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-18f88422-3da7-4a83-a7e2-b38aea3e6546 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:49.946725 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c27d17da-2108-4b3b-8efe-8494a6adadb1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:49.949512 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=100 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:49.957952 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c27d17da-2108-4b3b-8efe-8494a6adadb1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:49.958960 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c27d17da-2108-4b3b-8efe-8494a6adadb1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:49.961267 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c27d17da-2108-4b3b-8efe-8494a6adadb1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1724 microversion: 2.20 time: 0.225495 Sep 01 16:41:49.975913 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 373/774] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:49 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:49.990860 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-18f88422-3da7-4a83-a7e2-b38aea3e6546 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:49.998834 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-18f88422-3da7-4a83-a7e2-b38aea3e6546 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956" status: 200 len: 1364 microversion: 2.1 time: 0.203967 Sep 01 16:41:49.999430 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 402/775] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:49 2022] GET /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956 => generated 1364 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:50.244156 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-e11cb7dd-db00-4cca-b4d0-1e566ec87c07 req-d6cf0576-1b23-421f-bc08-1ce53c4152d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd88a09b-04d0-4c19-b78e-cedce17f0956", "name": "network-vif-plugged", "status": "completed", "tag": "7796cb2a-2d4a-4d32-86e4-943b86e85759"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:50.254742 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-e11cb7dd-db00-4cca-b4d0-1e566ec87c07 req-d6cf0576-1b23-421f-bc08-1ce53c4152d7 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:50.255220 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-e11cb7dd-db00-4cca-b4d0-1e566ec87c07 req-d6cf0576-1b23-421f-bc08-1ce53c4152d7 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:50.255762 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-e11cb7dd-db00-4cca-b4d0-1e566ec87c07 req-d6cf0576-1b23-421f-bc08-1ce53c4152d7 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:50.268251 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-e11cb7dd-db00-4cca-b4d0-1e566ec87c07 req-d6cf0576-1b23-421f-bc08-1ce53c4152d7 service nova] Creating event network-vif-plugged:7796cb2a-2d4a-4d32-86e4-943b86e85759 for instance cd88a09b-04d0-4c19-b78e-cedce17f0956 on hv-cinder-85221 Sep 01 16:41:50.274546 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-e11cb7dd-db00-4cca-b4d0-1e566ec87c07 req-d6cf0576-1b23-421f-bc08-1ce53c4152d7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033819 Sep 01 16:41:50.274546 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 374/776] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:50.987827 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-2f587ae7-3301-434d-b51a-d9c4d773f64a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:50.988466 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-2f587ae7-3301-434d-b51a-d9c4d773f64a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:50.992562 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=6 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:51.000843 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2f587ae7-3301-434d-b51a-d9c4d773f64a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:51.001493 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2f587ae7-3301-434d-b51a-d9c4d773f64a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:51.002122 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2f587ae7-3301-434d-b51a-d9c4d773f64a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:51.003062 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2f587ae7-3301-434d-b51a-d9c4d773f64a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:51.003659 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2f587ae7-3301-434d-b51a-d9c4d773f64a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:51.004270 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2f587ae7-3301-434d-b51a-d9c4d773f64a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:51.016839 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:51.018341 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=6 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:51.023145 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-31b0a3fa-ac72-45ea-9dda-7097aa1c4167 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:51.023876 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-31b0a3fa-ac72-45ea-9dda-7097aa1c4167 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: cd88a09b-04d0-4c19-b78e-cedce17f0956] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:51.030802 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-31b0a3fa-ac72-45ea-9dda-7097aa1c4167 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:51.031270 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-31b0a3fa-ac72-45ea-9dda-7097aa1c4167 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:51.031708 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-31b0a3fa-ac72-45ea-9dda-7097aa1c4167 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:51.032423 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-31b0a3fa-ac72-45ea-9dda-7097aa1c4167 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:51.032877 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-31b0a3fa-ac72-45ea-9dda-7097aa1c4167 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:51.033558 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-31b0a3fa-ac72-45ea-9dda-7097aa1c4167 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:51.208119 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-2f587ae7-3301-434d-b51a-d9c4d773f64a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:51.216669 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-31b0a3fa-ac72-45ea-9dda-7097aa1c4167 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:51.216857 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-2f587ae7-3301-434d-b51a-d9c4d773f64a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:51.218161 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-2f587ae7-3301-434d-b51a-d9c4d773f64a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:51.219323 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-2f587ae7-3301-434d-b51a-d9c4d773f64a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1724 microversion: 2.20 time: 0.237374 Sep 01 16:41:51.219917 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 403/777] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:50 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:51.225455 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-31b0a3fa-ac72-45ea-9dda-7097aa1c4167 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956" status: 200 len: 1364 microversion: 2.1 time: 0.209582 Sep 01 16:41:51.226257 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 375/778] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:51 2022] GET /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956 => generated 1364 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:52.243160 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7d599639-8628-4a77-a06f-f3dc2b8cab5a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:52.243765 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-7d599639-8628-4a77-a06f-f3dc2b8cab5a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:52.246862 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d3101552-b5fb-4d74-8dac-f674532a7c05 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:52.247544 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d3101552-b5fb-4d74-8dac-f674532a7c05 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: cd88a09b-04d0-4c19-b78e-cedce17f0956] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:52.250560 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7d599639-8628-4a77-a06f-f3dc2b8cab5a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:52.251044 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7d599639-8628-4a77-a06f-f3dc2b8cab5a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:52.251485 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7d599639-8628-4a77-a06f-f3dc2b8cab5a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:52.252181 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7d599639-8628-4a77-a06f-f3dc2b8cab5a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:52.252595 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7d599639-8628-4a77-a06f-f3dc2b8cab5a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:52.253005 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7d599639-8628-4a77-a06f-f3dc2b8cab5a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:52.254163 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d3101552-b5fb-4d74-8dac-f674532a7c05 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:52.254682 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d3101552-b5fb-4d74-8dac-f674532a7c05 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:52.255114 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d3101552-b5fb-4d74-8dac-f674532a7c05 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:52.255901 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d3101552-b5fb-4d74-8dac-f674532a7c05 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:52.256353 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d3101552-b5fb-4d74-8dac-f674532a7c05 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:52.256793 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d3101552-b5fb-4d74-8dac-f674532a7c05 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:52.466684 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-7d599639-8628-4a77-a06f-f3dc2b8cab5a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:52.471352 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d3101552-b5fb-4d74-8dac-f674532a7c05 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:52.475960 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-7d599639-8628-4a77-a06f-f3dc2b8cab5a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:52.477567 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-7d599639-8628-4a77-a06f-f3dc2b8cab5a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:52.478592 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-7d599639-8628-4a77-a06f-f3dc2b8cab5a tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1724 microversion: 2.20 time: 0.239980 Sep 01 16:41:52.479399 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 404/779] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:52 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:52.489455 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d3101552-b5fb-4d74-8dac-f674532a7c05 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956" status: 200 len: 1555 microversion: 2.1 time: 0.246633 Sep 01 16:41:52.490493 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 376/780] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:52 2022] GET /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956 => generated 1555 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:41:52.510814 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a975a177-18c7-4f19-a940-2de96029c235 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:52.511303 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-a975a177-18c7-4f19-a940-2de96029c235 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: cd88a09b-04d0-4c19-b78e-cedce17f0956] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:52.517480 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a975a177-18c7-4f19-a940-2de96029c235 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:52.517956 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a975a177-18c7-4f19-a940-2de96029c235 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:52.518381 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a975a177-18c7-4f19-a940-2de96029c235 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:52.519073 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a975a177-18c7-4f19-a940-2de96029c235 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:52.519542 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a975a177-18c7-4f19-a940-2de96029c235 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:52.519962 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a975a177-18c7-4f19-a940-2de96029c235 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:52.601942 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-a975a177-18c7-4f19-a940-2de96029c235 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094959 Sep 01 16:41:52.602524 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 405/781] 10.222.0.62 () {58 vars in 1275 bytes} [Thu Sep 1 16:41:52 2022] GET /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:41:53.502043 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a7f32a3f-89e8-450b-8d76-8a810431e0c5 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:53.502787 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a7f32a3f-89e8-450b-8d76-8a810431e0c5 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:53.509971 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a7f32a3f-89e8-450b-8d76-8a810431e0c5 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:53.510501 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a7f32a3f-89e8-450b-8d76-8a810431e0c5 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:53.510999 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a7f32a3f-89e8-450b-8d76-8a810431e0c5 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:53.511668 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a7f32a3f-89e8-450b-8d76-8a810431e0c5 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:53.512140 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a7f32a3f-89e8-450b-8d76-8a810431e0c5 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:53.512558 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a7f32a3f-89e8-450b-8d76-8a810431e0c5 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:53.626667 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-f8eac777-0ef8-49dc-b8c1-eda5723c12cf req-cb58e8c4-f4ba-4713-9d6b-c0c247d0e381 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd88a09b-04d0-4c19-b78e-cedce17f0956", "tag": "7796cb2a-2d4a-4d32-86e4-943b86e85759"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:53.640864 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-f8eac777-0ef8-49dc-b8c1-eda5723c12cf req-cb58e8c4-f4ba-4713-9d6b-c0c247d0e381 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:53.641702 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-f8eac777-0ef8-49dc-b8c1-eda5723c12cf req-cb58e8c4-f4ba-4713-9d6b-c0c247d0e381 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:53.642363 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-f8eac777-0ef8-49dc-b8c1-eda5723c12cf req-cb58e8c4-f4ba-4713-9d6b-c0c247d0e381 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:53.655178 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-f8eac777-0ef8-49dc-b8c1-eda5723c12cf req-cb58e8c4-f4ba-4713-9d6b-c0c247d0e381 service nova] Creating event network-changed:7796cb2a-2d4a-4d32-86e4-943b86e85759 for instance cd88a09b-04d0-4c19-b78e-cedce17f0956 on hv-cinder-85221 Sep 01 16:41:53.660941 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-f8eac777-0ef8-49dc-b8c1-eda5723c12cf req-cb58e8c4-f4ba-4713-9d6b-c0c247d0e381 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039988 Sep 01 16:41:53.662140 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 406/782] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:53.688179 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a7f32a3f-89e8-450b-8d76-8a810431e0c5 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:53.710129 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a7f32a3f-89e8-450b-8d76-8a810431e0c5 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:53.711543 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a7f32a3f-89e8-450b-8d76-8a810431e0c5 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:53.712745 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a7f32a3f-89e8-450b-8d76-8a810431e0c5 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1724 microversion: 2.20 time: 0.214747 Sep 01 16:41:53.713293 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 377/783] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:53 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:54.741139 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d1770ac5-60e6-4314-86a3-6ce09d74621f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:54.742197 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d1770ac5-60e6-4314-86a3-6ce09d74621f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:54.749988 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d1770ac5-60e6-4314-86a3-6ce09d74621f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:54.750763 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d1770ac5-60e6-4314-86a3-6ce09d74621f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:54.751397 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d1770ac5-60e6-4314-86a3-6ce09d74621f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:54.752440 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d1770ac5-60e6-4314-86a3-6ce09d74621f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:54.753020 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d1770ac5-60e6-4314-86a3-6ce09d74621f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:54.753612 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d1770ac5-60e6-4314-86a3-6ce09d74621f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:54.908212 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d1770ac5-60e6-4314-86a3-6ce09d74621f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:54.917247 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d1770ac5-60e6-4314-86a3-6ce09d74621f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:54.918685 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d1770ac5-60e6-4314-86a3-6ce09d74621f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:54.919837 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d1770ac5-60e6-4314-86a3-6ce09d74621f tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1724 microversion: 2.20 time: 0.186507 Sep 01 16:41:54.920427 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 407/784] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:54 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:55.942778 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-74bdeef4-738d-40f9-a635-50603f55e787 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:55.943651 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-74bdeef4-738d-40f9-a635-50603f55e787 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:55.950886 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-74bdeef4-738d-40f9-a635-50603f55e787 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:55.951385 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-74bdeef4-738d-40f9-a635-50603f55e787 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:55.951823 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-74bdeef4-738d-40f9-a635-50603f55e787 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:55.952567 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-74bdeef4-738d-40f9-a635-50603f55e787 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:55.953027 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-74bdeef4-738d-40f9-a635-50603f55e787 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:55.953454 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-74bdeef4-738d-40f9-a635-50603f55e787 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:56.087387 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-74bdeef4-738d-40f9-a635-50603f55e787 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:56.095943 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-74bdeef4-738d-40f9-a635-50603f55e787 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:56.097385 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-74bdeef4-738d-40f9-a635-50603f55e787 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:56.098584 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-74bdeef4-738d-40f9-a635-50603f55e787 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1745 microversion: 2.20 time: 0.159777 Sep 01 16:41:56.099172 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 378/785] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:55 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:57.122008 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-89d9e362-55e0-43a7-bf73-162c3e32e088 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:57.122605 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-89d9e362-55e0-43a7-bf73-162c3e32e088 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:57.129219 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-89d9e362-55e0-43a7-bf73-162c3e32e088 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:57.129709 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-89d9e362-55e0-43a7-bf73-162c3e32e088 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:57.130128 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-89d9e362-55e0-43a7-bf73-162c3e32e088 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:57.130922 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-89d9e362-55e0-43a7-bf73-162c3e32e088 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:57.131584 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-89d9e362-55e0-43a7-bf73-162c3e32e088 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:57.132044 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-89d9e362-55e0-43a7-bf73-162c3e32e088 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:57.273393 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-89d9e362-55e0-43a7-bf73-162c3e32e088 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:57.281501 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-89d9e362-55e0-43a7-bf73-162c3e32e088 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:57.282923 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-89d9e362-55e0-43a7-bf73-162c3e32e088 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:57.284107 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-89d9e362-55e0-43a7-bf73-162c3e32e088 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1745 microversion: 2.20 time: 0.166036 Sep 01 16:41:57.284651 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 408/786] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:57 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:58.309040 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7c5a5426-3ad3-498e-8e32-fc2985f0fb1b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:58.310164 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7c5a5426-3ad3-498e-8e32-fc2985f0fb1b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:58.317553 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7c5a5426-3ad3-498e-8e32-fc2985f0fb1b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:58.318363 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7c5a5426-3ad3-498e-8e32-fc2985f0fb1b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:58.318946 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7c5a5426-3ad3-498e-8e32-fc2985f0fb1b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:58.319802 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7c5a5426-3ad3-498e-8e32-fc2985f0fb1b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:58.320436 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7c5a5426-3ad3-498e-8e32-fc2985f0fb1b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:58.321011 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7c5a5426-3ad3-498e-8e32-fc2985f0fb1b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:58.504797 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7c5a5426-3ad3-498e-8e32-fc2985f0fb1b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:58.517671 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7c5a5426-3ad3-498e-8e32-fc2985f0fb1b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:58.519151 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7c5a5426-3ad3-498e-8e32-fc2985f0fb1b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:58.520490 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7c5a5426-3ad3-498e-8e32-fc2985f0fb1b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1740 microversion: 2.20 time: 0.215319 Sep 01 16:41:58.524075 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 379/787] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:58 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1740 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:41:59.547954 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-dcb9337e-8e76-4b33-8499-b4803979fafc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:59.549388 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-dcb9337e-8e76-4b33-8499-b4803979fafc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:59.556247 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dcb9337e-8e76-4b33-8499-b4803979fafc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:59.557030 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dcb9337e-8e76-4b33-8499-b4803979fafc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:59.557637 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dcb9337e-8e76-4b33-8499-b4803979fafc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:59.558514 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dcb9337e-8e76-4b33-8499-b4803979fafc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:59.559287 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dcb9337e-8e76-4b33-8499-b4803979fafc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:59.559700 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dcb9337e-8e76-4b33-8499-b4803979fafc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:59.964724 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-07c65c22-1d59-4e04-b1f4-47d542e00756 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:59.965456 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-07c65c22-1d59-4e04-b1f4-47d542e00756 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: e5e54e2a-0163-484c-9976-1a90a8fd17b9] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:59.972463 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-07c65c22-1d59-4e04-b1f4-47d542e00756 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:59.973086 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-07c65c22-1d59-4e04-b1f4-47d542e00756 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:59.973567 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-07c65c22-1d59-4e04-b1f4-47d542e00756 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:59.974962 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-07c65c22-1d59-4e04-b1f4-47d542e00756 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:59.975650 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-07c65c22-1d59-4e04-b1f4-47d542e00756 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:59.976125 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-07c65c22-1d59-4e04-b1f4-47d542e00756 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:00.003490 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-07c65c22-1d59-4e04-b1f4-47d542e00756 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9/ips" status: 200 len: 146 microversion: 2.1 time: 0.361338 Sep 01 16:42:00.004636 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 380/788] 10.222.0.62 () {58 vars in 1248 bytes} [Thu Sep 1 16:41:59 2022] GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9/ips => generated 146 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:42:00.059095 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-dcb9337e-8e76-4b33-8499-b4803979fafc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:00.068621 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-dcb9337e-8e76-4b33-8499-b4803979fafc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:00.070792 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-dcb9337e-8e76-4b33-8499-b4803979fafc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:00.072475 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-dcb9337e-8e76-4b33-8499-b4803979fafc tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1740 microversion: 2.20 time: 0.528981 Sep 01 16:42:00.088835 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 409/789] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:59 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1740 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:42:00.433049 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-1c06d367-2393-4b4e-9b40-209d110dda70 req-97672d13-3f9c-495d-aa03-0edc4892e456 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ae2e10f-5b22-4257-b92d-bc87e0df662b", "name": "network-vif-plugged", "status": "completed", "tag": "eff032c5-6a93-4a57-984a-8860719c6117"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:42:00.458199 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-1c06d367-2393-4b4e-9b40-209d110dda70 req-97672d13-3f9c-495d-aa03-0edc4892e456 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:00.459265 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-1c06d367-2393-4b4e-9b40-209d110dda70 req-97672d13-3f9c-495d-aa03-0edc4892e456 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:00.460923 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-1c06d367-2393-4b4e-9b40-209d110dda70 req-97672d13-3f9c-495d-aa03-0edc4892e456 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:00.500358 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-1c06d367-2393-4b4e-9b40-209d110dda70 req-97672d13-3f9c-495d-aa03-0edc4892e456 service nova] Creating event network-vif-plugged:eff032c5-6a93-4a57-984a-8860719c6117 for instance 0ae2e10f-5b22-4257-b92d-bc87e0df662b on hv-cinder-85221 Sep 01 16:42:00.510060 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-1c06d367-2393-4b4e-9b40-209d110dda70 req-97672d13-3f9c-495d-aa03-0edc4892e456 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081037 Sep 01 16:42:00.511664 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 381/790] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:42:01.099290 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-65b3f218-eafc-45b1-aa45-cffc59eb1d4e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:01.099978 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-65b3f218-eafc-45b1-aa45-cffc59eb1d4e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:01.106650 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-65b3f218-eafc-45b1-aa45-cffc59eb1d4e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:01.107135 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-65b3f218-eafc-45b1-aa45-cffc59eb1d4e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:01.107744 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-65b3f218-eafc-45b1-aa45-cffc59eb1d4e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:01.108475 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-65b3f218-eafc-45b1-aa45-cffc59eb1d4e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:01.108921 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-65b3f218-eafc-45b1-aa45-cffc59eb1d4e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:01.109523 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-65b3f218-eafc-45b1-aa45-cffc59eb1d4e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:01.150557 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:01.291340 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-65b3f218-eafc-45b1-aa45-cffc59eb1d4e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:01.304629 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-65b3f218-eafc-45b1-aa45-cffc59eb1d4e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:01.306526 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-65b3f218-eafc-45b1-aa45-cffc59eb1d4e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:01.308206 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-65b3f218-eafc-45b1-aa45-cffc59eb1d4e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1740 microversion: 2.20 time: 0.213405 Sep 01 16:42:01.325444 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 410/791] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:42:01 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1740 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:42:01.597366 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-30ef7d0a-1b73-4e43-9215-489fb3bfff63 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8435ee0a-a1cc-4d2b-83b4-013c7e8b7bb2"}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:42:01.599905 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-30ef7d0a-1b73-4e43-9215-489fb3bfff63 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: e5e54e2a-0163-484c-9976-1a90a8fd17b9] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:01.610213 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-30ef7d0a-1b73-4e43-9215-489fb3bfff63 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:01.611443 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-30ef7d0a-1b73-4e43-9215-489fb3bfff63 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:01.612254 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-30ef7d0a-1b73-4e43-9215-489fb3bfff63 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:01.613554 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-30ef7d0a-1b73-4e43-9215-489fb3bfff63 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:01.614288 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-30ef7d0a-1b73-4e43-9215-489fb3bfff63 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:01.614957 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-30ef7d0a-1b73-4e43-9215-489fb3bfff63 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:01.949667 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-30ef7d0a-1b73-4e43-9215-489fb3bfff63 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "POST /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.357184 Sep 01 16:42:01.951495 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 382/792] 10.222.0.62 () {60 vars in 1323 bytes} [Thu Sep 1 16:42:01 2022] POST /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9/os-volume_attachments => generated 194 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:42:02.341958 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0401e186-0b43-452b-81c6-4b915d0b3de9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:02.343583 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-0401e186-0b43-452b-81c6-4b915d0b3de9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:02.366778 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0401e186-0b43-452b-81c6-4b915d0b3de9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:02.368792 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0401e186-0b43-452b-81c6-4b915d0b3de9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:02.369435 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0401e186-0b43-452b-81c6-4b915d0b3de9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:02.370396 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0401e186-0b43-452b-81c6-4b915d0b3de9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:02.371592 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0401e186-0b43-452b-81c6-4b915d0b3de9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:02.372257 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0401e186-0b43-452b-81c6-4b915d0b3de9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:02.547084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-0401e186-0b43-452b-81c6-4b915d0b3de9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:02.561392 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-0401e186-0b43-452b-81c6-4b915d0b3de9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:02.564681 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-0401e186-0b43-452b-81c6-4b915d0b3de9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:02.566380 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-0401e186-0b43-452b-81c6-4b915d0b3de9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1740 microversion: 2.20 time: 0.239082 Sep 01 16:42:02.567244 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 411/793] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:42:02 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1740 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:42:03.590434 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c8ab413b-4c4d-4eb7-9cdd-96aac7c43bd4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:03.592014 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c8ab413b-4c4d-4eb7-9cdd-96aac7c43bd4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:03.599737 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c8ab413b-4c4d-4eb7-9cdd-96aac7c43bd4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:03.600223 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c8ab413b-4c4d-4eb7-9cdd-96aac7c43bd4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:03.600834 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c8ab413b-4c4d-4eb7-9cdd-96aac7c43bd4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:03.601799 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c8ab413b-4c4d-4eb7-9cdd-96aac7c43bd4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:03.602479 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c8ab413b-4c4d-4eb7-9cdd-96aac7c43bd4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:03.602937 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c8ab413b-4c4d-4eb7-9cdd-96aac7c43bd4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:03.767073 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c8ab413b-4c4d-4eb7-9cdd-96aac7c43bd4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:03.777078 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c8ab413b-4c4d-4eb7-9cdd-96aac7c43bd4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:03.778782 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c8ab413b-4c4d-4eb7-9cdd-96aac7c43bd4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:03.780092 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c8ab413b-4c4d-4eb7-9cdd-96aac7c43bd4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1740 microversion: 2.20 time: 0.194006 Sep 01 16:42:03.780734 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 383/794] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:42:03 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:42:04.804862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-91628167-c1d6-48de-99bc-eb80646adcdd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:04.807493 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-91628167-c1d6-48de-99bc-eb80646adcdd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:04.814766 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-91628167-c1d6-48de-99bc-eb80646adcdd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:04.815647 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-91628167-c1d6-48de-99bc-eb80646adcdd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:04.816315 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-91628167-c1d6-48de-99bc-eb80646adcdd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:04.817322 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-91628167-c1d6-48de-99bc-eb80646adcdd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:04.818202 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-91628167-c1d6-48de-99bc-eb80646adcdd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:04.818837 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-91628167-c1d6-48de-99bc-eb80646adcdd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:04.996393 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-91628167-c1d6-48de-99bc-eb80646adcdd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:05.020404 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-91628167-c1d6-48de-99bc-eb80646adcdd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:05.022739 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-91628167-c1d6-48de-99bc-eb80646adcdd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:05.024467 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-91628167-c1d6-48de-99bc-eb80646adcdd tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1740 microversion: 2.20 time: 0.224173 Sep 01 16:42:05.025378 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 412/795] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:42:04 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1740 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:42:06.050477 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-dba052c3-63fb-42b9-9e9b-3c8026ea9f08 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:06.051716 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-dba052c3-63fb-42b9-9e9b-3c8026ea9f08 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:06.054442 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:06.060164 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dba052c3-63fb-42b9-9e9b-3c8026ea9f08 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:06.060927 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dba052c3-63fb-42b9-9e9b-3c8026ea9f08 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:06.061635 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dba052c3-63fb-42b9-9e9b-3c8026ea9f08 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:06.062574 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dba052c3-63fb-42b9-9e9b-3c8026ea9f08 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:06.063268 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dba052c3-63fb-42b9-9e9b-3c8026ea9f08 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:06.063951 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-dba052c3-63fb-42b9-9e9b-3c8026ea9f08 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:06.266893 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-dba052c3-63fb-42b9-9e9b-3c8026ea9f08 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:06.278098 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-dba052c3-63fb-42b9-9e9b-3c8026ea9f08 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:06.284636 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-dba052c3-63fb-42b9-9e9b-3c8026ea9f08 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:06.285916 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-dba052c3-63fb-42b9-9e9b-3c8026ea9f08 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1740 microversion: 2.20 time: 0.239551 Sep 01 16:42:06.286549 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 384/796] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:42:06 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1740 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:42:07.318563 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-bcace526-da97-464d-9b9e-a7a3223597b7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:07.319419 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-bcace526-da97-464d-9b9e-a7a3223597b7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:07.327712 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bcace526-da97-464d-9b9e-a7a3223597b7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:07.328243 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bcace526-da97-464d-9b9e-a7a3223597b7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:07.328673 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bcace526-da97-464d-9b9e-a7a3223597b7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:07.329512 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bcace526-da97-464d-9b9e-a7a3223597b7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:07.330188 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bcace526-da97-464d-9b9e-a7a3223597b7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:07.330789 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bcace526-da97-464d-9b9e-a7a3223597b7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:07.486055 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-bcace526-da97-464d-9b9e-a7a3223597b7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:07.495927 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-bcace526-da97-464d-9b9e-a7a3223597b7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:07.497477 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-bcace526-da97-464d-9b9e-a7a3223597b7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:07.498754 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-bcace526-da97-464d-9b9e-a7a3223597b7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1740 microversion: 2.20 time: 0.185215 Sep 01 16:42:07.499406 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 413/797] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:42:07 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:42:08.522966 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a1a6fa7f-34aa-45b5-afb6-edbbfec11f85 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:08.523599 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a1a6fa7f-34aa-45b5-afb6-edbbfec11f85 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:08.532219 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a1a6fa7f-34aa-45b5-afb6-edbbfec11f85 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:08.532670 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a1a6fa7f-34aa-45b5-afb6-edbbfec11f85 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:08.533037 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a1a6fa7f-34aa-45b5-afb6-edbbfec11f85 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:08.533934 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a1a6fa7f-34aa-45b5-afb6-edbbfec11f85 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:08.534575 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a1a6fa7f-34aa-45b5-afb6-edbbfec11f85 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:08.535004 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a1a6fa7f-34aa-45b5-afb6-edbbfec11f85 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:08.606572 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-3f309e84-88a2-400f-a7ef-57f14c3c098c tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:08.611749 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-3f309e84-88a2-400f-a7ef-57f14c3c098c tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: e5e54e2a-0163-484c-9976-1a90a8fd17b9] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:08.621370 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3f309e84-88a2-400f-a7ef-57f14c3c098c tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:08.621843 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3f309e84-88a2-400f-a7ef-57f14c3c098c tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:08.622481 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3f309e84-88a2-400f-a7ef-57f14c3c098c tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:08.623376 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3f309e84-88a2-400f-a7ef-57f14c3c098c tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:08.624033 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3f309e84-88a2-400f-a7ef-57f14c3c098c tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:08.624626 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3f309e84-88a2-400f-a7ef-57f14c3c098c tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:08.666734 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-3f309e84-88a2-400f-a7ef-57f14c3c098c tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064828 Sep 01 16:42:08.667333 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 414/798] 10.222.0.62 () {58 vars in 1302 bytes} [Thu Sep 1 16:42:08 2022] GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:42:08.678740 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-440c834e-ba5c-468b-a85c-09b307a711dd tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:08.679281 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-440c834e-ba5c-468b-a85c-09b307a711dd tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: e5e54e2a-0163-484c-9976-1a90a8fd17b9] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:08.685795 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-440c834e-ba5c-468b-a85c-09b307a711dd tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:08.686300 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-440c834e-ba5c-468b-a85c-09b307a711dd tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:08.686692 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-440c834e-ba5c-468b-a85c-09b307a711dd tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:08.688113 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-440c834e-ba5c-468b-a85c-09b307a711dd tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:08.688566 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-440c834e-ba5c-468b-a85c-09b307a711dd tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:08.688982 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-440c834e-ba5c-468b-a85c-09b307a711dd tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:08.716473 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a1a6fa7f-34aa-45b5-afb6-edbbfec11f85 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:08.726793 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a1a6fa7f-34aa-45b5-afb6-edbbfec11f85 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:08.728691 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a1a6fa7f-34aa-45b5-afb6-edbbfec11f85 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:08.731142 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a1a6fa7f-34aa-45b5-afb6-edbbfec11f85 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1740 microversion: 2.20 time: 0.212592 Sep 01 16:42:08.732298 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 385/799] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:42:08 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1740 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:42:08.743219 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-440c834e-ba5c-468b-a85c-09b307a711dd tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9/os-volume_attachments/8435ee0a-a1cc-4d2b-83b4-013c7e8b7bb2" status: 200 len: 194 microversion: 2.1 time: 0.069121 Sep 01 16:42:08.744457 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 415/800] 10.222.0.62 () {58 vars in 1413 bytes} [Thu Sep 1 16:42:08 2022] GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9/os-volume_attachments/8435ee0a-a1cc-4d2b-83b4-013c7e8b7bb2 => generated 194 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:42:09.761018 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-45f48814-f6d3-4fdb-8f8e-06c92ecba6e9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:09.762113 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-45f48814-f6d3-4fdb-8f8e-06c92ecba6e9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:09.770112 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-45f48814-f6d3-4fdb-8f8e-06c92ecba6e9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:09.770669 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-45f48814-f6d3-4fdb-8f8e-06c92ecba6e9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:09.771216 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-45f48814-f6d3-4fdb-8f8e-06c92ecba6e9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:09.772191 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-45f48814-f6d3-4fdb-8f8e-06c92ecba6e9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:09.772724 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-45f48814-f6d3-4fdb-8f8e-06c92ecba6e9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:09.773166 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-45f48814-f6d3-4fdb-8f8e-06c92ecba6e9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:09.918295 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-45f48814-f6d3-4fdb-8f8e-06c92ecba6e9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:09.927509 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-45f48814-f6d3-4fdb-8f8e-06c92ecba6e9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:09.929092 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-45f48814-f6d3-4fdb-8f8e-06c92ecba6e9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:09.935351 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-45f48814-f6d3-4fdb-8f8e-06c92ecba6e9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1722 microversion: 2.20 time: 0.175919 Sep 01 16:42:09.935351 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 386/801] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:42:09 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:42:10.120960 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7924b3ba-de7f-4f1a-853e-885b4748dc3e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a507b639-3cd8-4b43-a753-861b7e4d16bd"}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:42:10.123347 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-7924b3ba-de7f-4f1a-853e-885b4748dc3e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: e5e54e2a-0163-484c-9976-1a90a8fd17b9] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:10.130102 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7924b3ba-de7f-4f1a-853e-885b4748dc3e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:10.130617 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7924b3ba-de7f-4f1a-853e-885b4748dc3e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:10.131176 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7924b3ba-de7f-4f1a-853e-885b4748dc3e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:10.131831 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7924b3ba-de7f-4f1a-853e-885b4748dc3e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:10.132337 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7924b3ba-de7f-4f1a-853e-885b4748dc3e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:10.132774 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7924b3ba-de7f-4f1a-853e-885b4748dc3e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:10.955420 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-80fbbce2-0891-42f6-9520-16a10aa3b7f7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:10.956035 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-80fbbce2-0891-42f6-9520-16a10aa3b7f7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:10.963514 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-80fbbce2-0891-42f6-9520-16a10aa3b7f7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:10.964033 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-80fbbce2-0891-42f6-9520-16a10aa3b7f7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:10.964471 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-80fbbce2-0891-42f6-9520-16a10aa3b7f7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:10.965162 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-80fbbce2-0891-42f6-9520-16a10aa3b7f7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:10.965615 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-80fbbce2-0891-42f6-9520-16a10aa3b7f7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:10.966039 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-80fbbce2-0891-42f6-9520-16a10aa3b7f7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:11.133296 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-80fbbce2-0891-42f6-9520-16a10aa3b7f7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:11.141808 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-80fbbce2-0891-42f6-9520-16a10aa3b7f7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:11.143244 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-80fbbce2-0891-42f6-9520-16a10aa3b7f7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:11.144518 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-80fbbce2-0891-42f6-9520-16a10aa3b7f7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1722 microversion: 2.20 time: 0.193296 Sep 01 16:42:11.145082 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 387/802] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:42:10 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:42:11.339910 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-7924b3ba-de7f-4f1a-853e-885b4748dc3e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "POST /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.222175 Sep 01 16:42:11.340721 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 416/803] 10.222.0.62 () {60 vars in 1323 bytes} [Thu Sep 1 16:42:10 2022] POST /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9/os-volume_attachments => generated 194 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:42:12.171548 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-cb9b1354-dd97-43e7-b7f4-42bb686d3c73 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:12.172124 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-cb9b1354-dd97-43e7-b7f4-42bb686d3c73 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:12.179548 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cb9b1354-dd97-43e7-b7f4-42bb686d3c73 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:12.180111 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cb9b1354-dd97-43e7-b7f4-42bb686d3c73 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:12.180556 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cb9b1354-dd97-43e7-b7f4-42bb686d3c73 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:12.181271 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cb9b1354-dd97-43e7-b7f4-42bb686d3c73 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:12.181733 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cb9b1354-dd97-43e7-b7f4-42bb686d3c73 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:12.183554 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cb9b1354-dd97-43e7-b7f4-42bb686d3c73 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:12.323464 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-cb9b1354-dd97-43e7-b7f4-42bb686d3c73 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:12.332086 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-cb9b1354-dd97-43e7-b7f4-42bb686d3c73 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:12.333790 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-cb9b1354-dd97-43e7-b7f4-42bb686d3c73 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:12.335078 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-cb9b1354-dd97-43e7-b7f4-42bb686d3c73 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1665 microversion: 2.20 time: 0.170157 Sep 01 16:42:12.335802 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 388/804] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:42:12 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1665 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:42:12.361967 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5483fe7d-4859-4be3-a1ee-a51f5c3ccdd9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "44cf956a-2539-40ae-be09-eede899ea124"}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:42:12.364590 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5483fe7d-4859-4be3-a1ee-a51f5c3ccdd9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:12.371875 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5483fe7d-4859-4be3-a1ee-a51f5c3ccdd9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:12.372447 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5483fe7d-4859-4be3-a1ee-a51f5c3ccdd9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:12.372890 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5483fe7d-4859-4be3-a1ee-a51f5c3ccdd9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:12.373593 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5483fe7d-4859-4be3-a1ee-a51f5c3ccdd9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:12.374225 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5483fe7d-4859-4be3-a1ee-a51f5c3ccdd9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:12.374653 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5483fe7d-4859-4be3-a1ee-a51f5c3ccdd9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:12.454417 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-bd01f6a5-8ea9-45ef-8bcf-3082354c7c49 req-7c4d2c21-058a-431d-8091-6a6de06ffb7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ae2e10f-5b22-4257-b92d-bc87e0df662b", "name": "network-vif-unplugged", "status": "completed", "tag": "eff032c5-6a93-4a57-984a-8860719c6117"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:42:12.467514 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-bd01f6a5-8ea9-45ef-8bcf-3082354c7c49 req-7c4d2c21-058a-431d-8091-6a6de06ffb7b service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:12.468504 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-bd01f6a5-8ea9-45ef-8bcf-3082354c7c49 req-7c4d2c21-058a-431d-8091-6a6de06ffb7b service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:12.469019 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-bd01f6a5-8ea9-45ef-8bcf-3082354c7c49 req-7c4d2c21-058a-431d-8091-6a6de06ffb7b service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:12.481924 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.compute.server_external_events [req-bd01f6a5-8ea9-45ef-8bcf-3082354c7c49 req-7c4d2c21-058a-431d-8091-6a6de06ffb7b service nova] Unable to find a host for instance 0ae2e10f-5b22-4257-b92d-bc87e0df662b. Dropping event network-vif-unplugged {{(pid=127199) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 01 16:42:12.482812 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-bd01f6a5-8ea9-45ef-8bcf-3082354c7c49 req-7c4d2c21-058a-431d-8091-6a6de06ffb7b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.190633 Sep 01 16:42:12.483634 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 417/805] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 192 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 01 16:42:12.567792 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:12.676489 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5483fe7d-4859-4be3-a1ee-a51f5c3ccdd9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "POST /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.318591 Sep 01 16:42:12.677245 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 389/806] 10.222.0.62 () {62 vars in 1364 bytes} [Thu Sep 1 16:42:12 2022] POST /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b/os-volume_attachments => generated 188 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 16:42:12.808021 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8f06c97b-cd75-4700-8513-ccc579b4d7ce tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:12.808713 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-8f06c97b-cd75-4700-8513-ccc579b4d7ce tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:12.816075 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8f06c97b-cd75-4700-8513-ccc579b4d7ce tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:12.816563 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8f06c97b-cd75-4700-8513-ccc579b4d7ce tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:12.816980 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8f06c97b-cd75-4700-8513-ccc579b4d7ce tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:12.817675 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8f06c97b-cd75-4700-8513-ccc579b4d7ce tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:12.818182 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8f06c97b-cd75-4700-8513-ccc579b4d7ce tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:12.818536 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8f06c97b-cd75-4700-8513-ccc579b4d7ce tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:13.118196 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8f06c97b-cd75-4700-8513-ccc579b4d7ce tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b/os-volume_attachments/44cf956a-2539-40ae-be09-eede899ea124" status: 202 len: 0 microversion: 2.20 time: 0.314385 Sep 01 16:42:13.118966 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 418/807] 10.222.0.62 () {60 vars in 1457 bytes} [Thu Sep 1 16:42:12 2022] DELETE /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b/os-volume_attachments/44cf956a-2539-40ae-be09-eede899ea124 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:42:13.187180 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ee581cce-c43e-4a23-8519-f973490d6c6e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:42:13.188163 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ee581cce-c43e-4a23-8519-f973490d6c6e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:13.198469 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ee581cce-c43e-4a23-8519-f973490d6c6e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:13.198952 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ee581cce-c43e-4a23-8519-f973490d6c6e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:13.199369 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ee581cce-c43e-4a23-8519-f973490d6c6e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:13.200100 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ee581cce-c43e-4a23-8519-f973490d6c6e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:13.200549 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ee581cce-c43e-4a23-8519-f973490d6c6e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:13.200969 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ee581cce-c43e-4a23-8519-f973490d6c6e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:13.232626 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ee581cce-c43e-4a23-8519-f973490d6c6e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127198) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 01 16:42:13.314760 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ee581cce-c43e-4a23-8519-f973490d6c6e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "POST /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b/action" status: 202 len: 0 microversion: 2.20 time: 0.134101 Sep 01 16:42:13.315641 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 390/808] 10.222.0.62 () {62 vars in 1319 bytes} [Thu Sep 1 16:42:13 2022] POST /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 01 16:42:13.325419 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-2ff403a5-0aec-4fbc-abb7-5c74d3c13e03 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:13.326236 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-2ff403a5-0aec-4fbc-abb7-5c74d3c13e03 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:13.333586 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2ff403a5-0aec-4fbc-abb7-5c74d3c13e03 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:13.334076 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2ff403a5-0aec-4fbc-abb7-5c74d3c13e03 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:13.334506 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2ff403a5-0aec-4fbc-abb7-5c74d3c13e03 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:13.335229 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2ff403a5-0aec-4fbc-abb7-5c74d3c13e03 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:13.335722 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2ff403a5-0aec-4fbc-abb7-5c74d3c13e03 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:13.336220 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2ff403a5-0aec-4fbc-abb7-5c74d3c13e03 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:13.498104 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-2ff403a5-0aec-4fbc-abb7-5c74d3c13e03 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:13.507997 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-2ff403a5-0aec-4fbc-abb7-5c74d3c13e03 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:13.510330 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-2ff403a5-0aec-4fbc-abb7-5c74d3c13e03 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:13.511557 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-2ff403a5-0aec-4fbc-abb7-5c74d3c13e03 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1673 microversion: 2.20 time: 0.191330 Sep 01 16:42:13.512350 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 419/809] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:42:13 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1673 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:42:14.538860 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3798f720-3ade-4186-be4f-605df8bef5f1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:14.539432 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-3798f720-3ade-4186-be4f-605df8bef5f1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:14.546414 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3798f720-3ade-4186-be4f-605df8bef5f1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:14.546912 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3798f720-3ade-4186-be4f-605df8bef5f1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:14.547379 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3798f720-3ade-4186-be4f-605df8bef5f1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:14.548285 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3798f720-3ade-4186-be4f-605df8bef5f1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:14.548825 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3798f720-3ade-4186-be4f-605df8bef5f1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:14.549269 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3798f720-3ade-4186-be4f-605df8bef5f1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:14.722543 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3798f720-3ade-4186-be4f-605df8bef5f1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:14.731416 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3798f720-3ade-4186-be4f-605df8bef5f1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:14.732879 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3798f720-3ade-4186-be4f-605df8bef5f1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:14.734054 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3798f720-3ade-4186-be4f-605df8bef5f1 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1731 microversion: 2.20 time: 0.200045 Sep 01 16:42:14.734618 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 391/810] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:42:14 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1731 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:42:15.758922 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b50f7e99-e6d8-42b4-a44e-6c9a2bb0bd6b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:15.759707 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-b50f7e99-e6d8-42b4-a44e-6c9a2bb0bd6b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:15.766905 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b50f7e99-e6d8-42b4-a44e-6c9a2bb0bd6b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:15.767389 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b50f7e99-e6d8-42b4-a44e-6c9a2bb0bd6b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:15.768039 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b50f7e99-e6d8-42b4-a44e-6c9a2bb0bd6b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:15.769054 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b50f7e99-e6d8-42b4-a44e-6c9a2bb0bd6b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:15.769664 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b50f7e99-e6d8-42b4-a44e-6c9a2bb0bd6b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:15.770237 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b50f7e99-e6d8-42b4-a44e-6c9a2bb0bd6b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:16.016051 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b50f7e99-e6d8-42b4-a44e-6c9a2bb0bd6b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:16.024769 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b50f7e99-e6d8-42b4-a44e-6c9a2bb0bd6b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:16.026516 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b50f7e99-e6d8-42b4-a44e-6c9a2bb0bd6b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:16.028605 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-b50f7e99-e6d8-42b4-a44e-6c9a2bb0bd6b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1731 microversion: 2.20 time: 0.273937 Sep 01 16:42:16.029975 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 420/811] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:42:15 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1731 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:42:17.053522 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c6dbb9ca-3e20-4477-a01c-b7e54a0e1ced tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:17.054188 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c6dbb9ca-3e20-4477-a01c-b7e54a0e1ced tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:17.061610 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c6dbb9ca-3e20-4477-a01c-b7e54a0e1ced tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:17.062109 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c6dbb9ca-3e20-4477-a01c-b7e54a0e1ced tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:17.062565 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c6dbb9ca-3e20-4477-a01c-b7e54a0e1ced tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:17.063379 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c6dbb9ca-3e20-4477-a01c-b7e54a0e1ced tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:17.064065 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c6dbb9ca-3e20-4477-a01c-b7e54a0e1ced tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:17.064637 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c6dbb9ca-3e20-4477-a01c-b7e54a0e1ced tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:17.219989 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c6dbb9ca-3e20-4477-a01c-b7e54a0e1ced tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:17.231657 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c6dbb9ca-3e20-4477-a01c-b7e54a0e1ced tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:17.233164 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c6dbb9ca-3e20-4477-a01c-b7e54a0e1ced tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:17.234444 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c6dbb9ca-3e20-4477-a01c-b7e54a0e1ced tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1731 microversion: 2.20 time: 0.184938 Sep 01 16:42:17.235000 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 392/812] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:42:17 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1731 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:42:18.272545 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-864d1f07-b33b-47b2-9ec6-d15d5470b600 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:18.273159 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-864d1f07-b33b-47b2-9ec6-d15d5470b600 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:18.280669 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-864d1f07-b33b-47b2-9ec6-d15d5470b600 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:18.280669 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-864d1f07-b33b-47b2-9ec6-d15d5470b600 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:18.280871 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-864d1f07-b33b-47b2-9ec6-d15d5470b600 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:18.282071 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-864d1f07-b33b-47b2-9ec6-d15d5470b600 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:18.282515 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-864d1f07-b33b-47b2-9ec6-d15d5470b600 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:18.282892 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-864d1f07-b33b-47b2-9ec6-d15d5470b600 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:18.471115 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-864d1f07-b33b-47b2-9ec6-d15d5470b600 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:18.479360 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-864d1f07-b33b-47b2-9ec6-d15d5470b600 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:18.480826 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-864d1f07-b33b-47b2-9ec6-d15d5470b600 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:18.482224 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-864d1f07-b33b-47b2-9ec6-d15d5470b600 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1731 microversion: 2.20 time: 0.215143 Sep 01 16:42:18.482792 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 421/813] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:42:18 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1731 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:42:19.509447 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-959219e2-42eb-45b6-936a-9a6e5b2b7802 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:19.510668 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-959219e2-42eb-45b6-936a-9a6e5b2b7802 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:19.521296 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-959219e2-42eb-45b6-936a-9a6e5b2b7802 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:19.522051 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-959219e2-42eb-45b6-936a-9a6e5b2b7802 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:19.522638 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-959219e2-42eb-45b6-936a-9a6e5b2b7802 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:19.523650 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-959219e2-42eb-45b6-936a-9a6e5b2b7802 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:19.524287 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-959219e2-42eb-45b6-936a-9a6e5b2b7802 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:19.524907 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-959219e2-42eb-45b6-936a-9a6e5b2b7802 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:19.692236 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-959219e2-42eb-45b6-936a-9a6e5b2b7802 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:19.710278 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-959219e2-42eb-45b6-936a-9a6e5b2b7802 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:19.713035 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-959219e2-42eb-45b6-936a-9a6e5b2b7802 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:19.715055 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-959219e2-42eb-45b6-936a-9a6e5b2b7802 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1731 microversion: 2.20 time: 0.211746 Sep 01 16:42:19.716004 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 393/814] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:42:19 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1731 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:42:20.749322 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-809965f2-7a8e-4cfc-889a-8220dbefed56 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:20.750580 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-809965f2-7a8e-4cfc-889a-8220dbefed56 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:20.758739 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=42 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:20.760559 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-809965f2-7a8e-4cfc-889a-8220dbefed56 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:20.761381 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-809965f2-7a8e-4cfc-889a-8220dbefed56 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:20.761988 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-809965f2-7a8e-4cfc-889a-8220dbefed56 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:20.763163 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-809965f2-7a8e-4cfc-889a-8220dbefed56 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:20.763975 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-809965f2-7a8e-4cfc-889a-8220dbefed56 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:20.764504 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-809965f2-7a8e-4cfc-889a-8220dbefed56 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:20.913731 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-809965f2-7a8e-4cfc-889a-8220dbefed56 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:20.927597 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-809965f2-7a8e-4cfc-889a-8220dbefed56 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:20.929069 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-809965f2-7a8e-4cfc-889a-8220dbefed56 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:20.930496 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-809965f2-7a8e-4cfc-889a-8220dbefed56 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1731 microversion: 2.20 time: 0.185014 Sep 01 16:42:20.931163 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 422/815] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:42:20 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1731 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:42:21.962767 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ee9b0066-0551-4044-918b-a1c4edbddb69 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:21.963466 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ee9b0066-0551-4044-918b-a1c4edbddb69 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:21.970332 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ee9b0066-0551-4044-918b-a1c4edbddb69 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:21.971241 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ee9b0066-0551-4044-918b-a1c4edbddb69 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:21.971684 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ee9b0066-0551-4044-918b-a1c4edbddb69 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:21.972412 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ee9b0066-0551-4044-918b-a1c4edbddb69 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:21.973119 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ee9b0066-0551-4044-918b-a1c4edbddb69 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:21.973545 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ee9b0066-0551-4044-918b-a1c4edbddb69 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:22.124164 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ee9b0066-0551-4044-918b-a1c4edbddb69 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:22.132874 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ee9b0066-0551-4044-918b-a1c4edbddb69 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:22.134330 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ee9b0066-0551-4044-918b-a1c4edbddb69 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:22.135654 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ee9b0066-0551-4044-918b-a1c4edbddb69 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1731 microversion: 2.20 time: 0.176816 Sep 01 16:42:22.151212 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 394/816] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:42:21 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1731 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:42:23.160310 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ff07c021-73ef-4cc6-b6b1-de02b258c6af tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:23.161212 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ff07c021-73ef-4cc6-b6b1-de02b258c6af tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:23.172285 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ff07c021-73ef-4cc6-b6b1-de02b258c6af tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:23.173030 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ff07c021-73ef-4cc6-b6b1-de02b258c6af tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:23.173627 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ff07c021-73ef-4cc6-b6b1-de02b258c6af tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:23.174665 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ff07c021-73ef-4cc6-b6b1-de02b258c6af tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:23.175421 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ff07c021-73ef-4cc6-b6b1-de02b258c6af tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:23.176213 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ff07c021-73ef-4cc6-b6b1-de02b258c6af tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:23.325406 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ff07c021-73ef-4cc6-b6b1-de02b258c6af tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:23.329220 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:23.334476 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ff07c021-73ef-4cc6-b6b1-de02b258c6af tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:23.336144 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ff07c021-73ef-4cc6-b6b1-de02b258c6af tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:23.337322 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ff07c021-73ef-4cc6-b6b1-de02b258c6af tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1731 microversion: 2.20 time: 0.182115 Sep 01 16:42:23.338078 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 423/817] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:42:23 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:42:24.365691 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5dd9059f-6d1b-4baf-b02b-d77f8715f22e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:24.366858 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5dd9059f-6d1b-4baf-b02b-d77f8715f22e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:24.381559 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5dd9059f-6d1b-4baf-b02b-d77f8715f22e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:24.382859 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5dd9059f-6d1b-4baf-b02b-d77f8715f22e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:24.384081 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5dd9059f-6d1b-4baf-b02b-d77f8715f22e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:24.386027 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5dd9059f-6d1b-4baf-b02b-d77f8715f22e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:24.387191 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5dd9059f-6d1b-4baf-b02b-d77f8715f22e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:24.388277 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5dd9059f-6d1b-4baf-b02b-d77f8715f22e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:24.575220 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5dd9059f-6d1b-4baf-b02b-d77f8715f22e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:24.586209 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5dd9059f-6d1b-4baf-b02b-d77f8715f22e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:24.587640 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5dd9059f-6d1b-4baf-b02b-d77f8715f22e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:24.588837 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5dd9059f-6d1b-4baf-b02b-d77f8715f22e tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1731 microversion: 2.20 time: 0.230902 Sep 01 16:42:24.590314 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 395/818] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:42:24 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1731 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:42:25.613084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-dcf23bcb-7435-41f0-8810-dc960226bdc8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:25.613698 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-dcf23bcb-7435-41f0-8810-dc960226bdc8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:25.621896 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dcf23bcb-7435-41f0-8810-dc960226bdc8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:25.622394 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dcf23bcb-7435-41f0-8810-dc960226bdc8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:25.622828 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dcf23bcb-7435-41f0-8810-dc960226bdc8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:25.623575 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dcf23bcb-7435-41f0-8810-dc960226bdc8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:25.624135 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dcf23bcb-7435-41f0-8810-dc960226bdc8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:25.624539 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dcf23bcb-7435-41f0-8810-dc960226bdc8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:25.781255 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-dcf23bcb-7435-41f0-8810-dc960226bdc8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:25.790490 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-dcf23bcb-7435-41f0-8810-dc960226bdc8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:25.792084 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-dcf23bcb-7435-41f0-8810-dc960226bdc8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:25.793686 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-dcf23bcb-7435-41f0-8810-dc960226bdc8 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1731 microversion: 2.20 time: 0.184570 Sep 01 16:42:25.794261 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 424/819] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:42:25 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1731 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:42:26.818056 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-bcad6446-f150-41db-8137-e55eb78ce159 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:26.818906 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-bcad6446-f150-41db-8137-e55eb78ce159 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:26.826538 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bcad6446-f150-41db-8137-e55eb78ce159 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:26.826942 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bcad6446-f150-41db-8137-e55eb78ce159 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:26.827373 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bcad6446-f150-41db-8137-e55eb78ce159 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:26.828283 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bcad6446-f150-41db-8137-e55eb78ce159 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:26.828730 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bcad6446-f150-41db-8137-e55eb78ce159 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:26.829148 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bcad6446-f150-41db-8137-e55eb78ce159 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:26.989156 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-bcad6446-f150-41db-8137-e55eb78ce159 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:26.997494 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-bcad6446-f150-41db-8137-e55eb78ce159 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:26.998965 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-bcad6446-f150-41db-8137-e55eb78ce159 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:27.000185 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-bcad6446-f150-41db-8137-e55eb78ce159 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1731 microversion: 2.20 time: 0.186037 Sep 01 16:42:27.000747 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 396/820] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:42:26 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:42:28.029591 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ad04d8e3-96b7-4681-9c29-9c2e813e564b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:28.030242 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ad04d8e3-96b7-4681-9c29-9c2e813e564b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:28.037061 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ad04d8e3-96b7-4681-9c29-9c2e813e564b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:28.037560 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ad04d8e3-96b7-4681-9c29-9c2e813e564b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:28.037990 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ad04d8e3-96b7-4681-9c29-9c2e813e564b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:28.038679 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ad04d8e3-96b7-4681-9c29-9c2e813e564b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:28.039360 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ad04d8e3-96b7-4681-9c29-9c2e813e564b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:28.039784 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ad04d8e3-96b7-4681-9c29-9c2e813e564b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:28.185417 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ad04d8e3-96b7-4681-9c29-9c2e813e564b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:28.194623 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ad04d8e3-96b7-4681-9c29-9c2e813e564b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:28.196157 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ad04d8e3-96b7-4681-9c29-9c2e813e564b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:28.197410 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ad04d8e3-96b7-4681-9c29-9c2e813e564b tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1731 microversion: 2.20 time: 0.172393 Sep 01 16:42:28.198290 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 425/821] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:42:28 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:42:29.222718 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2efd24ee-96f5-425a-9f8a-ea2163d09ebf tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:29.223759 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-2efd24ee-96f5-425a-9f8a-ea2163d09ebf tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:29.234232 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2efd24ee-96f5-425a-9f8a-ea2163d09ebf tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:29.236201 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2efd24ee-96f5-425a-9f8a-ea2163d09ebf tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:29.237550 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2efd24ee-96f5-425a-9f8a-ea2163d09ebf tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:29.240858 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2efd24ee-96f5-425a-9f8a-ea2163d09ebf tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:29.242613 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2efd24ee-96f5-425a-9f8a-ea2163d09ebf tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:29.243508 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2efd24ee-96f5-425a-9f8a-ea2163d09ebf tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:29.479681 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2efd24ee-96f5-425a-9f8a-ea2163d09ebf tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:29.488577 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2efd24ee-96f5-425a-9f8a-ea2163d09ebf tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:29.490056 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2efd24ee-96f5-425a-9f8a-ea2163d09ebf tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:29.491258 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2efd24ee-96f5-425a-9f8a-ea2163d09ebf tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1731 microversion: 2.20 time: 0.273637 Sep 01 16:42:29.492383 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 397/822] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:42:29 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1731 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:42:29.654341 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-eefd69f8-060f-45e8-8b61-86076552beb3 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:29.656607 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-eefd69f8-060f-45e8-8b61-86076552beb3 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: e5e54e2a-0163-484c-9976-1a90a8fd17b9] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:29.663645 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eefd69f8-060f-45e8-8b61-86076552beb3 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:29.664161 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eefd69f8-060f-45e8-8b61-86076552beb3 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:29.664612 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eefd69f8-060f-45e8-8b61-86076552beb3 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:29.665376 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eefd69f8-060f-45e8-8b61-86076552beb3 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:29.665836 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eefd69f8-060f-45e8-8b61-86076552beb3 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:29.666249 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eefd69f8-060f-45e8-8b61-86076552beb3 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:29.699309 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-eefd69f8-060f-45e8-8b61-86076552beb3 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048748 Sep 01 16:42:29.700649 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 426/823] 10.222.0.62 () {58 vars in 1302 bytes} [Thu Sep 1 16:42:29 2022] GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:42:29.845011 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2d722524-1ae8-44cc-bd2f-e5b7b602926c tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:29.845957 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-2d722524-1ae8-44cc-bd2f-e5b7b602926c tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: e5e54e2a-0163-484c-9976-1a90a8fd17b9] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:29.856797 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2d722524-1ae8-44cc-bd2f-e5b7b602926c tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:29.857945 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2d722524-1ae8-44cc-bd2f-e5b7b602926c tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:29.858985 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2d722524-1ae8-44cc-bd2f-e5b7b602926c tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:29.860016 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2d722524-1ae8-44cc-bd2f-e5b7b602926c tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:29.860788 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2d722524-1ae8-44cc-bd2f-e5b7b602926c tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:29.861716 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2d722524-1ae8-44cc-bd2f-e5b7b602926c tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:29.904078 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2d722524-1ae8-44cc-bd2f-e5b7b602926c tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9/os-volume_attachments/8435ee0a-a1cc-4d2b-83b4-013c7e8b7bb2" status: 200 len: 194 microversion: 2.1 time: 0.065785 Sep 01 16:42:29.904704 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 398/824] 10.222.0.62 () {58 vars in 1413 bytes} [Thu Sep 1 16:42:29 2022] GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9/os-volume_attachments/8435ee0a-a1cc-4d2b-83b4-013c7e8b7bb2 => generated 194 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:42:29.916132 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-eb45cb3e-fd32-4edb-bf9d-a1f67d94924f tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:29.916779 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-eb45cb3e-fd32-4edb-bf9d-a1f67d94924f tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: e5e54e2a-0163-484c-9976-1a90a8fd17b9] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:29.924362 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eb45cb3e-fd32-4edb-bf9d-a1f67d94924f tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:29.924890 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eb45cb3e-fd32-4edb-bf9d-a1f67d94924f tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:29.925502 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eb45cb3e-fd32-4edb-bf9d-a1f67d94924f tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:29.926023 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eb45cb3e-fd32-4edb-bf9d-a1f67d94924f tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:29.926472 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eb45cb3e-fd32-4edb-bf9d-a1f67d94924f tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:29.926891 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eb45cb3e-fd32-4edb-bf9d-a1f67d94924f tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:30.028810 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.objects.instance [None req-eb45cb3e-fd32-4edb-bf9d-a1f67d94924f tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lazy-loading 'services' on Instance uuid e5e54e2a-0163-484c-9976-1a90a8fd17b9 {{(pid=127199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:42:30.113531 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-eb45cb3e-fd32-4edb-bf9d-a1f67d94924f tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9/os-volume_attachments/8435ee0a-a1cc-4d2b-83b4-013c7e8b7bb2" status: 202 len: 0 microversion: 2.1 time: 0.202060 Sep 01 16:42:30.114129 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 427/825] 10.222.0.62 () {58 vars in 1416 bytes} [Thu Sep 1 16:42:29 2022] DELETE /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9/os-volume_attachments/8435ee0a-a1cc-4d2b-83b4-013c7e8b7bb2 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:42:30.515149 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-96df0822-f415-4b2b-8aba-99bc72a92905 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:30.516365 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-96df0822-f415-4b2b-8aba-99bc72a92905 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:30.525903 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-96df0822-f415-4b2b-8aba-99bc72a92905 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:30.526586 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-96df0822-f415-4b2b-8aba-99bc72a92905 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:30.527704 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-96df0822-f415-4b2b-8aba-99bc72a92905 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:30.528701 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-96df0822-f415-4b2b-8aba-99bc72a92905 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:30.529307 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-96df0822-f415-4b2b-8aba-99bc72a92905 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:30.530007 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-96df0822-f415-4b2b-8aba-99bc72a92905 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:30.681319 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-96df0822-f415-4b2b-8aba-99bc72a92905 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:30.690213 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-96df0822-f415-4b2b-8aba-99bc72a92905 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:30.691652 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-96df0822-f415-4b2b-8aba-99bc72a92905 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:30.692850 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-96df0822-f415-4b2b-8aba-99bc72a92905 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1731 microversion: 2.20 time: 0.181983 Sep 01 16:42:30.693417 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 399/826] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:42:30 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:42:31.272536 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-6a4f796f-0b54-46ef-95f5-c9f0cd2abfb9 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:31.273124 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-6a4f796f-0b54-46ef-95f5-c9f0cd2abfb9 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: e5e54e2a-0163-484c-9976-1a90a8fd17b9] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:31.286198 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6a4f796f-0b54-46ef-95f5-c9f0cd2abfb9 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:31.287869 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6a4f796f-0b54-46ef-95f5-c9f0cd2abfb9 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:31.288916 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6a4f796f-0b54-46ef-95f5-c9f0cd2abfb9 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:31.290717 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6a4f796f-0b54-46ef-95f5-c9f0cd2abfb9 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:31.291914 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6a4f796f-0b54-46ef-95f5-c9f0cd2abfb9 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:31.292630 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6a4f796f-0b54-46ef-95f5-c9f0cd2abfb9 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:31.338725 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-6a4f796f-0b54-46ef-95f5-c9f0cd2abfb9 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9/os-volume_attachments/a507b639-3cd8-4b43-a753-861b7e4d16bd" status: 200 len: 194 microversion: 2.1 time: 0.070912 Sep 01 16:42:31.339659 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 428/827] 10.222.0.62 () {58 vars in 1413 bytes} [Thu Sep 1 16:42:31 2022] GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9/os-volume_attachments/a507b639-3cd8-4b43-a753-861b7e4d16bd => generated 194 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:42:31.352742 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-adbd4d1c-0a95-4650-a2f5-2ad6f663d741 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:31.353825 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-adbd4d1c-0a95-4650-a2f5-2ad6f663d741 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: e5e54e2a-0163-484c-9976-1a90a8fd17b9] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:31.365540 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-adbd4d1c-0a95-4650-a2f5-2ad6f663d741 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:31.366139 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-adbd4d1c-0a95-4650-a2f5-2ad6f663d741 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:31.366739 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-adbd4d1c-0a95-4650-a2f5-2ad6f663d741 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:31.368226 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-adbd4d1c-0a95-4650-a2f5-2ad6f663d741 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:31.369258 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-adbd4d1c-0a95-4650-a2f5-2ad6f663d741 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:31.369949 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-adbd4d1c-0a95-4650-a2f5-2ad6f663d741 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:31.489324 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-adbd4d1c-0a95-4650-a2f5-2ad6f663d741 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lazy-loading 'services' on Instance uuid e5e54e2a-0163-484c-9976-1a90a8fd17b9 {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:42:31.587181 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-adbd4d1c-0a95-4650-a2f5-2ad6f663d741 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9/os-volume_attachments/a507b639-3cd8-4b43-a753-861b7e4d16bd" status: 202 len: 0 microversion: 2.1 time: 0.238974 Sep 01 16:42:31.588131 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 400/828] 10.222.0.62 () {58 vars in 1416 bytes} [Thu Sep 1 16:42:31 2022] DELETE /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9/os-volume_attachments/a507b639-3cd8-4b43-a753-861b7e4d16bd => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:42:31.716977 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-087aac21-98c8-4d35-ab1a-c40eed7e15ab tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:31.717520 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-087aac21-98c8-4d35-ab1a-c40eed7e15ab tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:31.723618 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-087aac21-98c8-4d35-ab1a-c40eed7e15ab tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:31.724133 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-087aac21-98c8-4d35-ab1a-c40eed7e15ab tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:31.724568 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-087aac21-98c8-4d35-ab1a-c40eed7e15ab tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:31.725245 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-087aac21-98c8-4d35-ab1a-c40eed7e15ab tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:31.725696 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-087aac21-98c8-4d35-ab1a-c40eed7e15ab tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:31.726107 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-087aac21-98c8-4d35-ab1a-c40eed7e15ab tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:31.868120 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-087aac21-98c8-4d35-ab1a-c40eed7e15ab tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:31.877956 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-087aac21-98c8-4d35-ab1a-c40eed7e15ab tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:31.879390 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-087aac21-98c8-4d35-ab1a-c40eed7e15ab tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:31.880579 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-087aac21-98c8-4d35-ab1a-c40eed7e15ab tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1731 microversion: 2.20 time: 0.167755 Sep 01 16:42:31.881190 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 429/829] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:42:31 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:42:32.906633 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e103810a-74f3-41a1-94d9-e52992453e91 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:32.907327 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e103810a-74f3-41a1-94d9-e52992453e91 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:32.914818 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e103810a-74f3-41a1-94d9-e52992453e91 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:32.915542 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e103810a-74f3-41a1-94d9-e52992453e91 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:32.916495 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e103810a-74f3-41a1-94d9-e52992453e91 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:32.918055 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e103810a-74f3-41a1-94d9-e52992453e91 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:32.918483 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e103810a-74f3-41a1-94d9-e52992453e91 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:32.918957 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e103810a-74f3-41a1-94d9-e52992453e91 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:33.074821 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e103810a-74f3-41a1-94d9-e52992453e91 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:33.089421 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e103810a-74f3-41a1-94d9-e52992453e91 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:33.091442 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e103810a-74f3-41a1-94d9-e52992453e91 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:33.093222 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e103810a-74f3-41a1-94d9-e52992453e91 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1731 microversion: 2.20 time: 0.191774 Sep 01 16:42:33.094038 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 401/830] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:42:32 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1731 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:42:33.345966 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-d7d59b98-0628-45b8-9b40-53c6839bcbad req-596e9359-0c78-4c30-a20e-d2fa3c6d8539 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ae2e10f-5b22-4257-b92d-bc87e0df662b", "name": "network-vif-plugged", "status": "completed", "tag": "eff032c5-6a93-4a57-984a-8860719c6117"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:42:33.357156 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-d7d59b98-0628-45b8-9b40-53c6839bcbad req-596e9359-0c78-4c30-a20e-d2fa3c6d8539 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:33.357635 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-d7d59b98-0628-45b8-9b40-53c6839bcbad req-596e9359-0c78-4c30-a20e-d2fa3c6d8539 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:33.358052 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-d7d59b98-0628-45b8-9b40-53c6839bcbad req-596e9359-0c78-4c30-a20e-d2fa3c6d8539 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:33.373089 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-d7d59b98-0628-45b8-9b40-53c6839bcbad req-596e9359-0c78-4c30-a20e-d2fa3c6d8539 service nova] Creating event network-vif-plugged:eff032c5-6a93-4a57-984a-8860719c6117 for instance 0ae2e10f-5b22-4257-b92d-bc87e0df662b on hv-cinder-85221 Sep 01 16:42:33.378542 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-d7d59b98-0628-45b8-9b40-53c6839bcbad req-596e9359-0c78-4c30-a20e-d2fa3c6d8539 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036388 Sep 01 16:42:33.379204 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 430/831] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:42:34.117746 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f0c1e45e-df85-48e5-8ebc-a2d0922826e5 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:34.118364 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f0c1e45e-df85-48e5-8ebc-a2d0922826e5 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:34.126178 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f0c1e45e-df85-48e5-8ebc-a2d0922826e5 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:34.126673 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f0c1e45e-df85-48e5-8ebc-a2d0922826e5 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:34.127109 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f0c1e45e-df85-48e5-8ebc-a2d0922826e5 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:34.127847 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f0c1e45e-df85-48e5-8ebc-a2d0922826e5 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:34.128382 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f0c1e45e-df85-48e5-8ebc-a2d0922826e5 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:34.128805 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f0c1e45e-df85-48e5-8ebc-a2d0922826e5 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:34.450749 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f0c1e45e-df85-48e5-8ebc-a2d0922826e5 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:34.459528 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f0c1e45e-df85-48e5-8ebc-a2d0922826e5 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:34.460999 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f0c1e45e-df85-48e5-8ebc-a2d0922826e5 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:34.462286 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f0c1e45e-df85-48e5-8ebc-a2d0922826e5 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1731 microversion: 2.20 time: 0.349315 Sep 01 16:42:34.463057 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 402/832] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:42:34 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1731 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:42:34.665478 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-3cd0f044-f4ad-4fb6-806e-c40e06cc790f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:34.666666 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-3cd0f044-f4ad-4fb6-806e-c40e06cc790f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: cd88a09b-04d0-4c19-b78e-cedce17f0956] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:34.673935 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3cd0f044-f4ad-4fb6-806e-c40e06cc790f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:34.674425 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3cd0f044-f4ad-4fb6-806e-c40e06cc790f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:34.674861 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3cd0f044-f4ad-4fb6-806e-c40e06cc790f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:34.675564 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3cd0f044-f4ad-4fb6-806e-c40e06cc790f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:34.676331 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3cd0f044-f4ad-4fb6-806e-c40e06cc790f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:34.676701 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3cd0f044-f4ad-4fb6-806e-c40e06cc790f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:34.702579 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-3cd0f044-f4ad-4fb6-806e-c40e06cc790f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956/ips" status: 200 len: 150 microversion: 2.1 time: 0.042814 Sep 01 16:42:34.703152 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 431/833] 10.222.0.62 () {58 vars in 1248 bytes} [Thu Sep 1 16:42:34 2022] GET /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:42:35.493777 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-069eb2ea-ae6d-4d04-af63-258dc8cd3457 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:35.494678 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-069eb2ea-ae6d-4d04-af63-258dc8cd3457 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:35.504294 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-069eb2ea-ae6d-4d04-af63-258dc8cd3457 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:35.504970 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-069eb2ea-ae6d-4d04-af63-258dc8cd3457 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:35.505515 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-069eb2ea-ae6d-4d04-af63-258dc8cd3457 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:35.506551 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-069eb2ea-ae6d-4d04-af63-258dc8cd3457 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:35.507188 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-069eb2ea-ae6d-4d04-af63-258dc8cd3457 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:35.507779 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-069eb2ea-ae6d-4d04-af63-258dc8cd3457 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:35.511525 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:35.648898 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-069eb2ea-ae6d-4d04-af63-258dc8cd3457 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:35.659024 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-069eb2ea-ae6d-4d04-af63-258dc8cd3457 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:35.660509 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-069eb2ea-ae6d-4d04-af63-258dc8cd3457 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:35.661701 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-069eb2ea-ae6d-4d04-af63-258dc8cd3457 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1731 microversion: 2.20 time: 0.173199 Sep 01 16:42:35.662252 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 403/834] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:42:35 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:42:36.685007 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0c0fbd83-7079-4f01-9641-b4c59d27e6d4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:36.685760 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-0c0fbd83-7079-4f01-9641-b4c59d27e6d4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:36.695792 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0c0fbd83-7079-4f01-9641-b4c59d27e6d4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:36.696460 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0c0fbd83-7079-4f01-9641-b4c59d27e6d4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:36.696865 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0c0fbd83-7079-4f01-9641-b4c59d27e6d4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:36.697943 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0c0fbd83-7079-4f01-9641-b4c59d27e6d4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:36.698424 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0c0fbd83-7079-4f01-9641-b4c59d27e6d4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:36.699156 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0c0fbd83-7079-4f01-9641-b4c59d27e6d4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:36.846042 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-0c0fbd83-7079-4f01-9641-b4c59d27e6d4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:36.858017 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-0c0fbd83-7079-4f01-9641-b4c59d27e6d4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:36.859356 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-0c0fbd83-7079-4f01-9641-b4c59d27e6d4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:36.860564 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-0c0fbd83-7079-4f01-9641-b4c59d27e6d4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1731 microversion: 2.20 time: 0.179601 Sep 01 16:42:36.861098 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 432/835] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:42:36 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:42:37.885473 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-223e02b7-1d1e-499d-aee1-93a01c348f87 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:37.886074 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-223e02b7-1d1e-499d-aee1-93a01c348f87 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:37.889044 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:37.896722 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-223e02b7-1d1e-499d-aee1-93a01c348f87 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:37.897336 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-223e02b7-1d1e-499d-aee1-93a01c348f87 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:37.897855 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-223e02b7-1d1e-499d-aee1-93a01c348f87 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:37.898630 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-223e02b7-1d1e-499d-aee1-93a01c348f87 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:37.899212 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-223e02b7-1d1e-499d-aee1-93a01c348f87 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:37.899651 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-223e02b7-1d1e-499d-aee1-93a01c348f87 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:38.049657 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-223e02b7-1d1e-499d-aee1-93a01c348f87 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:38.059560 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-223e02b7-1d1e-499d-aee1-93a01c348f87 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:38.060999 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-223e02b7-1d1e-499d-aee1-93a01c348f87 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:38.062186 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-223e02b7-1d1e-499d-aee1-93a01c348f87 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1731 microversion: 2.20 time: 0.181523 Sep 01 16:42:38.062717 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 404/836] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:42:37 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:42:38.237054 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0117c48a-05b4-4a7f-a580-650da6f8a32a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef608a9a-56d9-44af-a773-7ef936e71291"}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:42:38.239475 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-0117c48a-05b4-4a7f-a580-650da6f8a32a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: cd88a09b-04d0-4c19-b78e-cedce17f0956] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:38.246307 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0117c48a-05b4-4a7f-a580-650da6f8a32a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:38.246804 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0117c48a-05b4-4a7f-a580-650da6f8a32a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:38.247239 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0117c48a-05b4-4a7f-a580-650da6f8a32a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:38.247979 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0117c48a-05b4-4a7f-a580-650da6f8a32a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:38.248433 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0117c48a-05b4-4a7f-a580-650da6f8a32a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:38.248847 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0117c48a-05b4-4a7f-a580-650da6f8a32a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:38.265677 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7010b4eb-7cee-48ed-a171-4929f13e4ae1 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:38.268046 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7010b4eb-7cee-48ed-a171-4929f13e4ae1 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: e5e54e2a-0163-484c-9976-1a90a8fd17b9] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:38.274182 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7010b4eb-7cee-48ed-a171-4929f13e4ae1 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:38.274666 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7010b4eb-7cee-48ed-a171-4929f13e4ae1 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:38.275099 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7010b4eb-7cee-48ed-a171-4929f13e4ae1 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:38.275795 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7010b4eb-7cee-48ed-a171-4929f13e4ae1 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:38.276277 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7010b4eb-7cee-48ed-a171-4929f13e4ae1 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:38.276823 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7010b4eb-7cee-48ed-a171-4929f13e4ae1 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:38.309759 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7010b4eb-7cee-48ed-a171-4929f13e4ae1 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048344 Sep 01 16:42:38.310323 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 405/837] 10.222.0.62 () {58 vars in 1302 bytes} [Thu Sep 1 16:42:38 2022] GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 16:42:38.440479 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-759630dd-4208-4db1-867a-23065c68f0a8 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:38.442632 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-759630dd-4208-4db1-867a-23065c68f0a8 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: e5e54e2a-0163-484c-9976-1a90a8fd17b9] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:38.450068 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-759630dd-4208-4db1-867a-23065c68f0a8 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:38.450733 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-759630dd-4208-4db1-867a-23065c68f0a8 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:38.451198 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-759630dd-4208-4db1-867a-23065c68f0a8 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:38.451939 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-759630dd-4208-4db1-867a-23065c68f0a8 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:38.452435 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-759630dd-4208-4db1-867a-23065c68f0a8 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:38.452860 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-759630dd-4208-4db1-867a-23065c68f0a8 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:38.496629 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-759630dd-4208-4db1-867a-23065c68f0a8 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059630 Sep 01 16:42:38.497363 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 406/838] 10.222.0.62 () {58 vars in 1302 bytes} [Thu Sep 1 16:42:38 2022] GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 01 16:42:38.523258 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-0117c48a-05b4-4a7f-a580-650da6f8a32a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "POST /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290045 Sep 01 16:42:38.524391 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 433/839] 10.222.0.62 () {60 vars in 1323 bytes} [Thu Sep 1 16:42:38 2022] POST /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:42:38.580070 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-62ce5e6c-f46b-45c1-b047-c29f2adeb17e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:38.580568 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-62ce5e6c-f46b-45c1-b047-c29f2adeb17e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: e5e54e2a-0163-484c-9976-1a90a8fd17b9] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:38.587599 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-62ce5e6c-f46b-45c1-b047-c29f2adeb17e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:38.588141 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-62ce5e6c-f46b-45c1-b047-c29f2adeb17e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:38.588612 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-62ce5e6c-f46b-45c1-b047-c29f2adeb17e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:38.590818 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-62ce5e6c-f46b-45c1-b047-c29f2adeb17e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:38.591295 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-62ce5e6c-f46b-45c1-b047-c29f2adeb17e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:38.591726 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-62ce5e6c-f46b-45c1-b047-c29f2adeb17e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:38.620476 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-62ce5e6c-f46b-45c1-b047-c29f2adeb17e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: e5e54e2a-0163-484c-9976-1a90a8fd17b9] Going to try to terminate instance {{(pid=127198) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:42:38.724061 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-62ce5e6c-f46b-45c1-b047-c29f2adeb17e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9" status: 204 len: 0 microversion: 2.1 time: 0.147629 Sep 01 16:42:38.724776 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 407/840] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Sep 1 16:42:38 2022] DELETE /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:42:38.735023 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-6972c8c2-7d9d-492a-9bbe-4b5d5dd6bd15 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:38.735937 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-6972c8c2-7d9d-492a-9bbe-4b5d5dd6bd15 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: e5e54e2a-0163-484c-9976-1a90a8fd17b9] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:38.743110 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6972c8c2-7d9d-492a-9bbe-4b5d5dd6bd15 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:38.743611 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6972c8c2-7d9d-492a-9bbe-4b5d5dd6bd15 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:38.744075 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6972c8c2-7d9d-492a-9bbe-4b5d5dd6bd15 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:38.744769 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6972c8c2-7d9d-492a-9bbe-4b5d5dd6bd15 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:38.745351 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6972c8c2-7d9d-492a-9bbe-4b5d5dd6bd15 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:38.746170 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6972c8c2-7d9d-492a-9bbe-4b5d5dd6bd15 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:38.910704 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-6972c8c2-7d9d-492a-9bbe-4b5d5dd6bd15 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:38.921243 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-6972c8c2-7d9d-492a-9bbe-4b5d5dd6bd15 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9" status: 200 len: 1672 microversion: 2.1 time: 0.190616 Sep 01 16:42:38.921893 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 434/841] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:38 2022] GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9 => generated 1672 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:39.087881 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-088cafb1-96c9-4fff-bb09-137c715bc122 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:39.088708 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-088cafb1-96c9-4fff-bb09-137c715bc122 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:39.095830 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-088cafb1-96c9-4fff-bb09-137c715bc122 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:39.096375 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-088cafb1-96c9-4fff-bb09-137c715bc122 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:39.096844 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-088cafb1-96c9-4fff-bb09-137c715bc122 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:39.097557 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-088cafb1-96c9-4fff-bb09-137c715bc122 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:39.098503 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-088cafb1-96c9-4fff-bb09-137c715bc122 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:39.098932 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-088cafb1-96c9-4fff-bb09-137c715bc122 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:39.243988 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-088cafb1-96c9-4fff-bb09-137c715bc122 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:39.252589 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-088cafb1-96c9-4fff-bb09-137c715bc122 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:39.253984 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-088cafb1-96c9-4fff-bb09-137c715bc122 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:39.255406 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-088cafb1-96c9-4fff-bb09-137c715bc122 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1731 microversion: 2.20 time: 0.172434 Sep 01 16:42:39.255995 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 408/842] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:42:39 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:42:39.944279 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-927a7d83-08be-4db5-9786-92ff820d741e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:39.944869 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-927a7d83-08be-4db5-9786-92ff820d741e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: e5e54e2a-0163-484c-9976-1a90a8fd17b9] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:39.952804 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-927a7d83-08be-4db5-9786-92ff820d741e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:39.953798 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-927a7d83-08be-4db5-9786-92ff820d741e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:39.955456 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-927a7d83-08be-4db5-9786-92ff820d741e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:39.956202 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-927a7d83-08be-4db5-9786-92ff820d741e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:39.956653 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-927a7d83-08be-4db5-9786-92ff820d741e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:39.957073 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-927a7d83-08be-4db5-9786-92ff820d741e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:40.106760 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-927a7d83-08be-4db5-9786-92ff820d741e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:40.114698 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-927a7d83-08be-4db5-9786-92ff820d741e tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9" status: 200 len: 1672 microversion: 2.1 time: 0.174844 Sep 01 16:42:40.115256 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 435/843] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:39 2022] GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9 => generated 1672 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:40.283777 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ec383968-dcf0-44e3-b172-c28f5d955a57 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:40.284653 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ec383968-dcf0-44e3-b172-c28f5d955a57 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:40.292919 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ec383968-dcf0-44e3-b172-c28f5d955a57 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:40.293403 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ec383968-dcf0-44e3-b172-c28f5d955a57 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:40.294442 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ec383968-dcf0-44e3-b172-c28f5d955a57 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:40.295265 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ec383968-dcf0-44e3-b172-c28f5d955a57 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:40.295723 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ec383968-dcf0-44e3-b172-c28f5d955a57 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:40.296172 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ec383968-dcf0-44e3-b172-c28f5d955a57 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:40.452103 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ec383968-dcf0-44e3-b172-c28f5d955a57 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:40.461295 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ec383968-dcf0-44e3-b172-c28f5d955a57 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:40.462726 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ec383968-dcf0-44e3-b172-c28f5d955a57 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:40.463986 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ec383968-dcf0-44e3-b172-c28f5d955a57 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1731 microversion: 2.20 time: 0.184841 Sep 01 16:42:40.465312 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 409/844] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:42:40 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:42:41.137852 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-295752b2-f323-47dc-841b-2c0fe6dbdc91 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:41.138429 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-295752b2-f323-47dc-841b-2c0fe6dbdc91 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: e5e54e2a-0163-484c-9976-1a90a8fd17b9] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:41.149365 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-295752b2-f323-47dc-841b-2c0fe6dbdc91 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:41.150167 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-295752b2-f323-47dc-841b-2c0fe6dbdc91 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:41.150855 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-295752b2-f323-47dc-841b-2c0fe6dbdc91 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:41.151812 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-295752b2-f323-47dc-841b-2c0fe6dbdc91 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:41.152381 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-295752b2-f323-47dc-841b-2c0fe6dbdc91 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:41.152822 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-295752b2-f323-47dc-841b-2c0fe6dbdc91 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:41.379345 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-295752b2-f323-47dc-841b-2c0fe6dbdc91 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:41.388692 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-295752b2-f323-47dc-841b-2c0fe6dbdc91 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9" status: 200 len: 1672 microversion: 2.1 time: 0.255904 Sep 01 16:42:41.389256 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 436/845] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:41 2022] GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9 => generated 1672 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:41.488972 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-fc336463-ee54-4054-82b1-46e015854dad tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:41.489563 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-fc336463-ee54-4054-82b1-46e015854dad tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:41.497410 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fc336463-ee54-4054-82b1-46e015854dad tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:41.498239 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fc336463-ee54-4054-82b1-46e015854dad tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:41.498875 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fc336463-ee54-4054-82b1-46e015854dad tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:41.499776 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fc336463-ee54-4054-82b1-46e015854dad tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:41.500451 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fc336463-ee54-4054-82b1-46e015854dad tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:41.501071 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fc336463-ee54-4054-82b1-46e015854dad tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:41.722946 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-fc336463-ee54-4054-82b1-46e015854dad tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:41.732080 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-fc336463-ee54-4054-82b1-46e015854dad tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:41.733535 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-fc336463-ee54-4054-82b1-46e015854dad tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:41.734724 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-fc336463-ee54-4054-82b1-46e015854dad tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1718 microversion: 2.20 time: 0.249743 Sep 01 16:42:41.735284 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 410/846] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:42:41 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1718 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:42:42.047365 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-c21115b7-87d5-4423-8422-58f420c60f06 req-0bba729e-e72d-4fdd-be17-717d1b07c23e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5e54e2a-0163-484c-9976-1a90a8fd17b9", "name": "network-vif-deleted", "tag": "b208a6b2-98cf-49b5-a8db-4c367884ea7b"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:42:42.057343 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-c21115b7-87d5-4423-8422-58f420c60f06 req-0bba729e-e72d-4fdd-be17-717d1b07c23e service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:42.057975 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-c21115b7-87d5-4423-8422-58f420c60f06 req-0bba729e-e72d-4fdd-be17-717d1b07c23e service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:42.058527 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-c21115b7-87d5-4423-8422-58f420c60f06 req-0bba729e-e72d-4fdd-be17-717d1b07c23e service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:42.072762 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-c21115b7-87d5-4423-8422-58f420c60f06 req-0bba729e-e72d-4fdd-be17-717d1b07c23e service nova] Creating event network-vif-deleted:b208a6b2-98cf-49b5-a8db-4c367884ea7b for instance e5e54e2a-0163-484c-9976-1a90a8fd17b9 on hv-cinder-85221 Sep 01 16:42:42.078617 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-c21115b7-87d5-4423-8422-58f420c60f06 req-0bba729e-e72d-4fdd-be17-717d1b07c23e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184613 Sep 01 16:42:42.079382 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 437/847] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:42:42.410837 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-78a0855b-ae20-4701-9ce2-06dd6726d380 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:42.411441 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-78a0855b-ae20-4701-9ce2-06dd6726d380 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: e5e54e2a-0163-484c-9976-1a90a8fd17b9] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:42.418176 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-78a0855b-ae20-4701-9ce2-06dd6726d380 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:42.418567 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-78a0855b-ae20-4701-9ce2-06dd6726d380 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:42.418996 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-78a0855b-ae20-4701-9ce2-06dd6726d380 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:42.419703 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-78a0855b-ae20-4701-9ce2-06dd6726d380 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:42.420180 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-78a0855b-ae20-4701-9ce2-06dd6726d380 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:42.420774 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-78a0855b-ae20-4701-9ce2-06dd6726d380 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:42.491056 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-78a0855b-ae20-4701-9ce2-06dd6726d380 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:42.500399 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-78a0855b-ae20-4701-9ce2-06dd6726d380 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9" status: 200 len: 1604 microversion: 2.1 time: 0.093266 Sep 01 16:42:42.500992 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 411/848] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:42 2022] GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9 => generated 1604 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:43.522508 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-378e2a53-2534-431e-82fe-cdd84ec58f34 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:43.523160 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-378e2a53-2534-431e-82fe-cdd84ec58f34 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: e5e54e2a-0163-484c-9976-1a90a8fd17b9] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:43.530580 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-378e2a53-2534-431e-82fe-cdd84ec58f34 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:43.531110 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-378e2a53-2534-431e-82fe-cdd84ec58f34 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:43.531591 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-378e2a53-2534-431e-82fe-cdd84ec58f34 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:43.532285 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-378e2a53-2534-431e-82fe-cdd84ec58f34 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:43.532738 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-378e2a53-2534-431e-82fe-cdd84ec58f34 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:43.533163 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-378e2a53-2534-431e-82fe-cdd84ec58f34 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:43.604380 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-378e2a53-2534-431e-82fe-cdd84ec58f34 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:43.614448 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-378e2a53-2534-431e-82fe-cdd84ec58f34 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9" status: 200 len: 1320 microversion: 2.1 time: 0.096211 Sep 01 16:42:43.615039 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 438/849] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:43 2022] GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9 => generated 1320 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:44.635882 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-4bb4f271-44e4-4690-9a7c-26f592a34fd3 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:44.636745 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-4bb4f271-44e4-4690-9a7c-26f592a34fd3 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: e5e54e2a-0163-484c-9976-1a90a8fd17b9] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:44.644165 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4bb4f271-44e4-4690-9a7c-26f592a34fd3 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:44.644739 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4bb4f271-44e4-4690-9a7c-26f592a34fd3 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:44.645209 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4bb4f271-44e4-4690-9a7c-26f592a34fd3 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:44.645940 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4bb4f271-44e4-4690-9a7c-26f592a34fd3 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:44.646427 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4bb4f271-44e4-4690-9a7c-26f592a34fd3 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:44.646890 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4bb4f271-44e4-4690-9a7c-26f592a34fd3 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:44.687710 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4bb4f271-44e4-4690-9a7c-26f592a34fd3 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:44.688192 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4bb4f271-44e4-4690-9a7c-26f592a34fd3 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:44.689017 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4bb4f271-44e4-4690-9a7c-26f592a34fd3 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:44.689486 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-4bb4f271-44e4-4690-9a7c-26f592a34fd3 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lazy-loading 'fault' on Instance uuid e5e54e2a-0163-484c-9976-1a90a8fd17b9 {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:42:44.733059 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-4bb4f271-44e4-4690-9a7c-26f592a34fd3 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c3f8f28b147fc838533baf62b72af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2ea34aea99498eb36647be71aec5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:44.741276 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-4bb4f271-44e4-4690-9a7c-26f592a34fd3 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9" status: 200 len: 1325 microversion: 2.1 time: 0.109710 Sep 01 16:42:44.741882 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 412/850] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:44 2022] GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9 => generated 1325 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:45.763876 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-1692e1d3-8875-446a-8610-84d6dae48251 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:45.764538 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-1692e1d3-8875-446a-8610-84d6dae48251 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: e5e54e2a-0163-484c-9976-1a90a8fd17b9] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:45.771785 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1692e1d3-8875-446a-8610-84d6dae48251 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:45.772308 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1692e1d3-8875-446a-8610-84d6dae48251 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:45.772740 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1692e1d3-8875-446a-8610-84d6dae48251 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:45.773460 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1692e1d3-8875-446a-8610-84d6dae48251 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:45.773920 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1692e1d3-8875-446a-8610-84d6dae48251 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:45.774341 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1692e1d3-8875-446a-8610-84d6dae48251 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:45.789352 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-1692e1d3-8875-446a-8610-84d6dae48251 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] HTTP exception thrown: Instance e5e54e2a-0163-484c-9976-1a90a8fd17b9 could not be found. Sep 01 16:42:45.791033 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-1692e1d3-8875-446a-8610-84d6dae48251 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Request method failure captured: Sep 01 16:42:45.791033 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: request: GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9 HTTP/1.1 Sep 01 16:42:45.791033 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 01 16:42:45.791033 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 01 16:42:45.791033 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Connection: close Sep 01 16:42:45.791033 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 01 16:42:45.791033 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 01 16:42:45.791033 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Host: 10.222.0.62 Sep 01 16:42:45.791033 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 01 16:42:45.791033 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 01 16:42:45.791033 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjEN-K2rHO5_6mEnKeD6mym-6cImk-4p7IPqzSyInBRSOPCBmISrGJrS_5QzYpTocaV_mMwLwQVawcfbXpZhhqNsVfiWomgC95jI-4zuabKHIyiZRHL4hHml7yhd0haaFIfMKUTx3oGMWDfNuCY-ZQIqb2HF_tuMUs4l2bPvDV6iovGYI Sep 01 16:42:45.791033 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 01 16:42:45.791033 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 01 16:42:45.791033 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 01 16:42:45.791033 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 01 16:42:45.791033 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 01 16:42:45.791033 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 01 16:42:45.791033 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Id: af2ea34aea99498eb36647be71aec5e8 Sep 01 16:42:45.791033 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-AttachVolumeTestJSON-471958966 Sep 01 16:42:45.791033 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 01 16:42:45.791033 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 01 16:42:45.793165 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/af2ea34aea99498eb36647be71aec5e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/af2ea34aea99498eb36647be71aec5e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_af2ea34aea99498eb36647be71aec5e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/af2ea34aea99498eb36647be71aec5e8"}]}] Sep 01 16:42:45.793165 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-AttachVolumeTestJSON-471958966 Sep 01 16:42:45.793165 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Id: af2ea34aea99498eb36647be71aec5e8 Sep 01 16:42:45.793165 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-AttachVolumeTestJSON-471958966 Sep 01 16:42:45.793165 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User: tempest-AttachVolumeTestJSON-471958966-project Sep 01 16:42:45.793165 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 01 16:42:45.793165 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 01 16:42:45.793165 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Id: 2c1c3f8f28b147fc838533baf62b72af Sep 01 16:42:45.793165 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-AttachVolumeTestJSON-471958966-project Sep 01 16:42:45.793165 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: method: > Sep 01 16:42:45.793165 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: exception: Instance e5e54e2a-0163-484c-9976-1a90a8fd17b9 could not be found. Sep 01 16:42:45.793165 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: action_args: {'id': 'e5e54e2a-0163-484c-9976-1a90a8fd17b9'} Sep 01 16:42:45.794072 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:42:45.794072 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:45.794072 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:42:45.794072 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:42:45.794072 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:42:45.794072 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:42:45.794072 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:42:45.794072 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:42:45.794072 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:42:45.794072 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:42:45.794072 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5e54e2a-0163-484c-9976-1a90a8fd17b9 could not be found. Sep 01 16:42:45.794072 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:42:45.794072 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:45.794072 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:42:45.794072 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:45.794072 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:45.794072 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:45.794072 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:42:45.794072 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:42:45.794072 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:42:45.795608 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:42:45.795608 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:42:45.795608 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:42:45.795608 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:42:45.795608 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:42:45.795608 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:42:45.795608 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:42:45.795608 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5e54e2a-0163-484c-9976-1a90a8fd17b9 could not be found. Sep 01 16:42:45.795608 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:42:45.795608 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:45.795608 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:42:45.795608 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:45.795608 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:45.795608 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:45.795608 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:42:45.795608 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:42:45.795608 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5e54e2a-0163-484c-9976-1a90a8fd17b9 could not be found. Sep 01 16:42:45.795608 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:42:45.797076 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-1692e1d3-8875-446a-8610-84d6dae48251 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Returning 404 to user: Instance e5e54e2a-0163-484c-9976-1a90a8fd17b9 could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:42:45.797076 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-1692e1d3-8875-446a-8610-84d6dae48251 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9" status: 404 len: 111 microversion: 2.1 time: 0.032936 Sep 01 16:42:45.797076 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 439/851] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:45 2022] GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:42:45.801983 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1b9550d8-ab3b-406e-baf3-1e5e6f8966ab tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '.version_select at 0x7f94823283a0>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:45.825644 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1b9550d8-ab3b-406e-baf3-1e5e6f8966ab tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-67985811" status: 202 len: 0 microversion: 2.1 time: 0.027473 Sep 01 16:42:45.826255 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 413/852] 10.222.0.62 () {58 vars in 1215 bytes} [Thu Sep 1 16:42:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-67985811 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:42:47.313857 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-36520d84-5402-4873-a8a3-a5c7121afac8 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:47.314442 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-36520d84-5402-4873-a8a3-a5c7121afac8 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: cd88a09b-04d0-4c19-b78e-cedce17f0956] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:47.325072 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-36520d84-5402-4873-a8a3-a5c7121afac8 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:47.325589 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-36520d84-5402-4873-a8a3-a5c7121afac8 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:47.326035 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-36520d84-5402-4873-a8a3-a5c7121afac8 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:47.326858 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-36520d84-5402-4873-a8a3-a5c7121afac8 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:47.327443 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-36520d84-5402-4873-a8a3-a5c7121afac8 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:47.327953 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-36520d84-5402-4873-a8a3-a5c7121afac8 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:47.414559 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:47.418950 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.objects.instance [None req-36520d84-5402-4873-a8a3-a5c7121afac8 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lazy-loading 'services' on Instance uuid cd88a09b-04d0-4c19-b78e-cedce17f0956 {{(pid=127199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:42:47.497047 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-36520d84-5402-4873-a8a3-a5c7121afac8 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "DELETE /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956/os-volume_attachments/ef608a9a-56d9-44af-a773-7ef936e71291" status: 202 len: 0 microversion: 2.1 time: 0.187937 Sep 01 16:42:47.497637 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 440/853] 10.222.0.62 () {58 vars in 1416 bytes} [Thu Sep 1 16:42:47 2022] DELETE /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956/os-volume_attachments/ef608a9a-56d9-44af-a773-7ef936e71291 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:42:47.507357 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ef90564b-552f-4014-8c45-3789bab45c4a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:47.511239 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ef90564b-552f-4014-8c45-3789bab45c4a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: cd88a09b-04d0-4c19-b78e-cedce17f0956] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:47.517932 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ef90564b-552f-4014-8c45-3789bab45c4a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:47.518864 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ef90564b-552f-4014-8c45-3789bab45c4a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:47.519145 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ef90564b-552f-4014-8c45-3789bab45c4a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:47.520222 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ef90564b-552f-4014-8c45-3789bab45c4a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:47.520699 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ef90564b-552f-4014-8c45-3789bab45c4a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:47.521149 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ef90564b-552f-4014-8c45-3789bab45c4a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:47.569238 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ef90564b-552f-4014-8c45-3789bab45c4a tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066844 Sep 01 16:42:47.569810 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 414/854] 10.222.0.62 () {58 vars in 1302 bytes} [Thu Sep 1 16:42:47 2022] GET /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:42:48.583336 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-6c18d4ce-844b-48af-9b19-e701bbb01ba2 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:48.585676 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-6c18d4ce-844b-48af-9b19-e701bbb01ba2 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: cd88a09b-04d0-4c19-b78e-cedce17f0956] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:48.592917 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6c18d4ce-844b-48af-9b19-e701bbb01ba2 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:48.593393 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6c18d4ce-844b-48af-9b19-e701bbb01ba2 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:48.593817 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6c18d4ce-844b-48af-9b19-e701bbb01ba2 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:48.594565 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6c18d4ce-844b-48af-9b19-e701bbb01ba2 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:48.595001 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6c18d4ce-844b-48af-9b19-e701bbb01ba2 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:48.595413 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6c18d4ce-844b-48af-9b19-e701bbb01ba2 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:48.629537 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-6c18d4ce-844b-48af-9b19-e701bbb01ba2 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051215 Sep 01 16:42:48.636116 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 441/855] 10.222.0.62 () {58 vars in 1302 bytes} [Thu Sep 1 16:42:48 2022] GET /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 16:42:48.710543 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ab84967b-a47a-493f-bce8-e00da85f02c8 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:48.711050 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ab84967b-a47a-493f-bce8-e00da85f02c8 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: cd88a09b-04d0-4c19-b78e-cedce17f0956] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:48.719438 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ab84967b-a47a-493f-bce8-e00da85f02c8 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:48.720175 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ab84967b-a47a-493f-bce8-e00da85f02c8 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:48.720593 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ab84967b-a47a-493f-bce8-e00da85f02c8 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:48.721279 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ab84967b-a47a-493f-bce8-e00da85f02c8 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:48.721903 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ab84967b-a47a-493f-bce8-e00da85f02c8 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:48.722311 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ab84967b-a47a-493f-bce8-e00da85f02c8 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:48.749115 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ab84967b-a47a-493f-bce8-e00da85f02c8 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: cd88a09b-04d0-4c19-b78e-cedce17f0956] Going to try to terminate instance {{(pid=127198) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:42:48.833459 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ab84967b-a47a-493f-bce8-e00da85f02c8 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "DELETE /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956" status: 204 len: 0 microversion: 2.1 time: 0.126794 Sep 01 16:42:48.834668 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 415/856] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Sep 1 16:42:48 2022] DELETE /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:42:48.843181 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-64c20fdb-0837-4a46-84f5-e3f4d4f86c25 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:48.843786 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-64c20fdb-0837-4a46-84f5-e3f4d4f86c25 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: cd88a09b-04d0-4c19-b78e-cedce17f0956] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:48.851736 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-64c20fdb-0837-4a46-84f5-e3f4d4f86c25 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:48.852553 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-64c20fdb-0837-4a46-84f5-e3f4d4f86c25 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:48.853168 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-64c20fdb-0837-4a46-84f5-e3f4d4f86c25 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:48.854070 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-64c20fdb-0837-4a46-84f5-e3f4d4f86c25 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:48.854731 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-64c20fdb-0837-4a46-84f5-e3f4d4f86c25 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:48.854847 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ee6f1868-c0de-4eed-aa1c-416c4f352c95 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:48.855418 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ee6f1868-c0de-4eed-aa1c-416c4f352c95 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: e5e54e2a-0163-484c-9976-1a90a8fd17b9] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:48.855563 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-64c20fdb-0837-4a46-84f5-e3f4d4f86c25 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:48.865140 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ee6f1868-c0de-4eed-aa1c-416c4f352c95 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:48.867737 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ee6f1868-c0de-4eed-aa1c-416c4f352c95 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:48.868276 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ee6f1868-c0de-4eed-aa1c-416c4f352c95 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:48.869018 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ee6f1868-c0de-4eed-aa1c-416c4f352c95 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:48.869488 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ee6f1868-c0de-4eed-aa1c-416c4f352c95 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:48.870073 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ee6f1868-c0de-4eed-aa1c-416c4f352c95 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:48.887790 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-ee6f1868-c0de-4eed-aa1c-416c4f352c95 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] HTTP exception thrown: Instance e5e54e2a-0163-484c-9976-1a90a8fd17b9 could not be found. Sep 01 16:42:48.889576 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ee6f1868-c0de-4eed-aa1c-416c4f352c95 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Request method failure captured: Sep 01 16:42:48.889576 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: request: DELETE /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9 HTTP/1.1 Sep 01 16:42:48.889576 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 01 16:42:48.889576 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 01 16:42:48.889576 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Connection: close Sep 01 16:42:48.889576 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 01 16:42:48.889576 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 01 16:42:48.889576 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Host: 10.222.0.62 Sep 01 16:42:48.889576 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 01 16:42:48.889576 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 01 16:42:48.889576 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjEN-K2rHO5_6mEnKeD6mym-6cImk-4p7IPqzSyInBRSOPCBmISrGJrS_5QzYpTocaV_mMwLwQVawcfbXpZhhqNsVfiWomgC95jI-4zuabKHIyiZRHL4hHml7yhd0haaFIfMKUTx3oGMWDfNuCY-ZQIqb2HF_tuMUs4l2bPvDV6iovGYI Sep 01 16:42:48.889576 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 01 16:42:48.889576 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 01 16:42:48.889576 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 01 16:42:48.889576 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 01 16:42:48.889576 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 01 16:42:48.889576 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 01 16:42:48.889576 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Id: af2ea34aea99498eb36647be71aec5e8 Sep 01 16:42:48.889576 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-AttachVolumeTestJSON-471958966 Sep 01 16:42:48.889576 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 01 16:42:48.889576 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 01 16:42:48.891254 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/af2ea34aea99498eb36647be71aec5e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/af2ea34aea99498eb36647be71aec5e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_af2ea34aea99498eb36647be71aec5e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/af2ea34aea99498eb36647be71aec5e8"}]}] Sep 01 16:42:48.891254 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-AttachVolumeTestJSON-471958966 Sep 01 16:42:48.891254 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Id: af2ea34aea99498eb36647be71aec5e8 Sep 01 16:42:48.891254 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-AttachVolumeTestJSON-471958966 Sep 01 16:42:48.891254 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User: tempest-AttachVolumeTestJSON-471958966-project Sep 01 16:42:48.891254 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 01 16:42:48.891254 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 01 16:42:48.891254 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Id: 2c1c3f8f28b147fc838533baf62b72af Sep 01 16:42:48.891254 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-AttachVolumeTestJSON-471958966-project Sep 01 16:42:48.891254 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: method: > Sep 01 16:42:48.891254 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: exception: Instance e5e54e2a-0163-484c-9976-1a90a8fd17b9 could not be found. Sep 01 16:42:48.891254 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: action_args: {'id': 'e5e54e2a-0163-484c-9976-1a90a8fd17b9'} Sep 01 16:42:48.892017 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:42:48.892017 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:48.892017 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:42:48.892017 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:42:48.892017 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:42:48.892017 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:42:48.892017 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:42:48.892017 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:42:48.892017 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:42:48.892017 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:42:48.892017 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5e54e2a-0163-484c-9976-1a90a8fd17b9 could not be found. Sep 01 16:42:48.892017 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:42:48.892017 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:48.892017 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:42:48.892017 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:48.892017 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:48.892017 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:48.892017 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:42:48.892017 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:42:48.892017 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:42:48.893173 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:42:48.893173 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 16:42:48.893173 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 16:42:48.893173 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 16:42:48.893173 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 16:42:48.893173 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:42:48.893173 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:42:48.893173 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:42:48.893173 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:42:48.893173 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5e54e2a-0163-484c-9976-1a90a8fd17b9 could not be found. Sep 01 16:42:48.893173 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:42:48.893173 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:48.893173 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:42:48.893173 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:48.893173 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:48.893173 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:48.893173 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:42:48.893173 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:42:48.893173 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5e54e2a-0163-484c-9976-1a90a8fd17b9 could not be found. Sep 01 16:42:48.893173 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:42:48.894457 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ee6f1868-c0de-4eed-aa1c-416c4f352c95 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Returning 404 to user: Instance e5e54e2a-0163-484c-9976-1a90a8fd17b9 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:42:48.894457 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ee6f1868-c0de-4eed-aa1c-416c4f352c95 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9" status: 404 len: 111 microversion: 2.1 time: 0.046161 Sep 01 16:42:48.894457 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 416/857] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Sep 1 16:42:48 2022] DELETE /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 16:42:48.903516 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e9101131-6d7d-49c4-8d69-6285a23e5b64 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:48.904603 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e9101131-6d7d-49c4-8d69-6285a23e5b64 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: e5e54e2a-0163-484c-9976-1a90a8fd17b9] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:48.912840 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e9101131-6d7d-49c4-8d69-6285a23e5b64 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:48.913470 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e9101131-6d7d-49c4-8d69-6285a23e5b64 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:48.914132 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e9101131-6d7d-49c4-8d69-6285a23e5b64 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:48.915038 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e9101131-6d7d-49c4-8d69-6285a23e5b64 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:48.915701 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e9101131-6d7d-49c4-8d69-6285a23e5b64 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:48.916516 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e9101131-6d7d-49c4-8d69-6285a23e5b64 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:48.936164 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-e9101131-6d7d-49c4-8d69-6285a23e5b64 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] HTTP exception thrown: Instance e5e54e2a-0163-484c-9976-1a90a8fd17b9 could not be found. Sep 01 16:42:48.941191 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e9101131-6d7d-49c4-8d69-6285a23e5b64 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Request method failure captured: Sep 01 16:42:48.941191 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9 HTTP/1.1 Sep 01 16:42:48.941191 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 01 16:42:48.941191 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 01 16:42:48.941191 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Connection: close Sep 01 16:42:48.941191 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 01 16:42:48.941191 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 01 16:42:48.941191 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Host: 10.222.0.62 Sep 01 16:42:48.941191 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 01 16:42:48.941191 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 01 16:42:48.941191 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjEN-K2rHO5_6mEnKeD6mym-6cImk-4p7IPqzSyInBRSOPCBmISrGJrS_5QzYpTocaV_mMwLwQVawcfbXpZhhqNsVfiWomgC95jI-4zuabKHIyiZRHL4hHml7yhd0haaFIfMKUTx3oGMWDfNuCY-ZQIqb2HF_tuMUs4l2bPvDV6iovGYI Sep 01 16:42:48.941191 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 01 16:42:48.941191 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 01 16:42:48.941191 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 01 16:42:48.941191 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 01 16:42:48.941191 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 01 16:42:48.941191 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 01 16:42:48.941191 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Id: af2ea34aea99498eb36647be71aec5e8 Sep 01 16:42:48.941191 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-AttachVolumeTestJSON-471958966 Sep 01 16:42:48.941191 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 01 16:42:48.941191 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 01 16:42:48.942645 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/af2ea34aea99498eb36647be71aec5e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/af2ea34aea99498eb36647be71aec5e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_af2ea34aea99498eb36647be71aec5e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/af2ea34aea99498eb36647be71aec5e8"}]}] Sep 01 16:42:48.942645 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-AttachVolumeTestJSON-471958966 Sep 01 16:42:48.942645 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Id: af2ea34aea99498eb36647be71aec5e8 Sep 01 16:42:48.942645 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-AttachVolumeTestJSON-471958966 Sep 01 16:42:48.942645 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User: tempest-AttachVolumeTestJSON-471958966-project Sep 01 16:42:48.942645 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 01 16:42:48.942645 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 01 16:42:48.942645 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Id: 2c1c3f8f28b147fc838533baf62b72af Sep 01 16:42:48.942645 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-AttachVolumeTestJSON-471958966-project Sep 01 16:42:48.942645 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: method: > Sep 01 16:42:48.942645 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: exception: Instance e5e54e2a-0163-484c-9976-1a90a8fd17b9 could not be found. Sep 01 16:42:48.942645 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: action_args: {'id': 'e5e54e2a-0163-484c-9976-1a90a8fd17b9'} Sep 01 16:42:48.943853 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:42:48.943853 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:48.943853 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:42:48.943853 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:42:48.943853 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:42:48.943853 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:42:48.943853 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:42:48.943853 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:42:48.943853 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:42:48.943853 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:42:48.943853 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5e54e2a-0163-484c-9976-1a90a8fd17b9 could not be found. Sep 01 16:42:48.943853 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:42:48.943853 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:48.943853 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:42:48.943853 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:48.943853 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:48.943853 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:48.943853 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:42:48.943853 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:42:48.943853 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:42:48.945067 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:42:48.945067 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:42:48.945067 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:42:48.945067 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:42:48.945067 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:42:48.945067 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:42:48.945067 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:42:48.945067 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5e54e2a-0163-484c-9976-1a90a8fd17b9 could not be found. Sep 01 16:42:48.945067 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:42:48.945067 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:48.945067 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:42:48.945067 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:48.945067 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:48.945067 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:48.945067 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:42:48.945067 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:42:48.945067 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5e54e2a-0163-484c-9976-1a90a8fd17b9 could not be found. Sep 01 16:42:48.945067 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:42:48.948342 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e9101131-6d7d-49c4-8d69-6285a23e5b64 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Returning 404 to user: Instance e5e54e2a-0163-484c-9976-1a90a8fd17b9 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:42:48.948342 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e9101131-6d7d-49c4-8d69-6285a23e5b64 tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9" status: 404 len: 111 microversion: 2.1 time: 0.043175 Sep 01 16:42:48.948342 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 417/858] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:48 2022] GET /compute/v2.1/servers/e5e54e2a-0163-484c-9976-1a90a8fd17b9 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 16:42:49.026584 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-64c20fdb-0837-4a46-84f5-e3f4d4f86c25 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:49.034992 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-64c20fdb-0837-4a46-84f5-e3f4d4f86c25 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956" status: 200 len: 1679 microversion: 2.1 time: 0.195818 Sep 01 16:42:49.035634 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 442/859] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:48 2022] GET /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956 => generated 1679 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:50.058939 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e10e8491-4e59-490c-ae14-d4d0501478fd tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:50.059546 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e10e8491-4e59-490c-ae14-d4d0501478fd tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: cd88a09b-04d0-4c19-b78e-cedce17f0956] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:50.069828 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e10e8491-4e59-490c-ae14-d4d0501478fd tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:50.070336 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e10e8491-4e59-490c-ae14-d4d0501478fd tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:50.070812 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e10e8491-4e59-490c-ae14-d4d0501478fd tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:50.071502 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e10e8491-4e59-490c-ae14-d4d0501478fd tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:50.071978 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e10e8491-4e59-490c-ae14-d4d0501478fd tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:50.072770 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e10e8491-4e59-490c-ae14-d4d0501478fd tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:50.096483 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:50.117740 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-3983b71e-f985-484d-a03b-0754d13bfd2c tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:50.118374 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-3983b71e-f985-484d-a03b-0754d13bfd2c tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:50.125393 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3983b71e-f985-484d-a03b-0754d13bfd2c tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:50.126103 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3983b71e-f985-484d-a03b-0754d13bfd2c tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:50.126728 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3983b71e-f985-484d-a03b-0754d13bfd2c tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:50.127699 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3983b71e-f985-484d-a03b-0754d13bfd2c tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:50.128409 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3983b71e-f985-484d-a03b-0754d13bfd2c tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:50.128979 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3983b71e-f985-484d-a03b-0754d13bfd2c tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:50.146214 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-3983b71e-f985-484d-a03b-0754d13bfd2c tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] HTTP exception thrown: Instance a1bf96dd-b79a-403b-aa81-985c692df037 could not be found. Sep 01 16:42:50.147871 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-3983b71e-f985-484d-a03b-0754d13bfd2c tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Request method failure captured: Sep 01 16:42:50.147871 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: request: DELETE /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 HTTP/1.1 Sep 01 16:42:50.147871 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 01 16:42:50.147871 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 01 16:42:50.147871 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Connection: close Sep 01 16:42:50.147871 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 01 16:42:50.147871 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 01 16:42:50.147871 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Host: 10.222.0.62 Sep 01 16:42:50.147871 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 01 16:42:50.147871 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 01 16:42:50.147871 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjEN-K2rHO5_6mEnKeD6mym-6cImk-4p7IPqzSyInBRSOPCBmISrGJrS_5QzYpTocaV_mMwLwQVawcfbXpZhhqNsVfiWomgC95jI-4zuabKHIyiZRHL4hHml7yhd0haaFIfMKUTx3oGMWDfNuCY-ZQIqb2HF_tuMUs4l2bPvDV6iovGYI Sep 01 16:42:50.147871 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 01 16:42:50.147871 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 01 16:42:50.147871 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 01 16:42:50.147871 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 01 16:42:50.147871 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 01 16:42:50.147871 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 01 16:42:50.147871 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Id: af2ea34aea99498eb36647be71aec5e8 Sep 01 16:42:50.147871 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-AttachVolumeTestJSON-471958966 Sep 01 16:42:50.147871 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 01 16:42:50.147871 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 01 16:42:50.149456 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/af2ea34aea99498eb36647be71aec5e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/af2ea34aea99498eb36647be71aec5e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_af2ea34aea99498eb36647be71aec5e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/af2ea34aea99498eb36647be71aec5e8"}]}] Sep 01 16:42:50.149456 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-AttachVolumeTestJSON-471958966 Sep 01 16:42:50.149456 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Id: af2ea34aea99498eb36647be71aec5e8 Sep 01 16:42:50.149456 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-AttachVolumeTestJSON-471958966 Sep 01 16:42:50.149456 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User: tempest-AttachVolumeTestJSON-471958966-project Sep 01 16:42:50.149456 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 01 16:42:50.149456 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 01 16:42:50.149456 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Id: 2c1c3f8f28b147fc838533baf62b72af Sep 01 16:42:50.149456 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-AttachVolumeTestJSON-471958966-project Sep 01 16:42:50.149456 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: method: > Sep 01 16:42:50.149456 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: exception: Instance a1bf96dd-b79a-403b-aa81-985c692df037 could not be found. Sep 01 16:42:50.149456 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: action_args: {'id': 'a1bf96dd-b79a-403b-aa81-985c692df037'} Sep 01 16:42:50.150355 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:42:50.150355 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:50.150355 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:42:50.150355 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:42:50.150355 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:42:50.150355 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:42:50.150355 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:42:50.150355 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:42:50.150355 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:42:50.150355 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:42:50.150355 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1bf96dd-b79a-403b-aa81-985c692df037 could not be found. Sep 01 16:42:50.150355 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:42:50.150355 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:50.150355 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:42:50.150355 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:50.150355 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:50.150355 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:50.150355 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:42:50.150355 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:42:50.150355 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:42:50.152080 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:42:50.152080 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 16:42:50.152080 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 16:42:50.152080 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 16:42:50.152080 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 16:42:50.152080 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:42:50.152080 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:42:50.152080 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:42:50.152080 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:42:50.152080 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1bf96dd-b79a-403b-aa81-985c692df037 could not be found. Sep 01 16:42:50.152080 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:42:50.152080 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:50.152080 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:42:50.152080 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:50.152080 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:50.152080 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:50.152080 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:42:50.152080 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:42:50.152080 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1bf96dd-b79a-403b-aa81-985c692df037 could not be found. Sep 01 16:42:50.152080 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:42:50.154151 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-3983b71e-f985-484d-a03b-0754d13bfd2c tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Returning 404 to user: Instance a1bf96dd-b79a-403b-aa81-985c692df037 could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:42:50.154151 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-3983b71e-f985-484d-a03b-0754d13bfd2c tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 404 len: 111 microversion: 2.1 time: 0.036422 Sep 01 16:42:50.154151 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 443/860] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Sep 1 16:42:50 2022] DELETE /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 16:42:50.158521 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-aa75c0d5-03a3-4924-b8e8-ff4773a2725d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:50.159126 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-aa75c0d5-03a3-4924-b8e8-ff4773a2725d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] [instance: a1bf96dd-b79a-403b-aa81-985c692df037] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:50.165659 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aa75c0d5-03a3-4924-b8e8-ff4773a2725d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:50.166141 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aa75c0d5-03a3-4924-b8e8-ff4773a2725d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:50.166711 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aa75c0d5-03a3-4924-b8e8-ff4773a2725d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:50.167586 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aa75c0d5-03a3-4924-b8e8-ff4773a2725d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:50.168060 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aa75c0d5-03a3-4924-b8e8-ff4773a2725d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:50.168477 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aa75c0d5-03a3-4924-b8e8-ff4773a2725d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:50.184297 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-aa75c0d5-03a3-4924-b8e8-ff4773a2725d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] HTTP exception thrown: Instance a1bf96dd-b79a-403b-aa81-985c692df037 could not be found. Sep 01 16:42:50.186615 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-aa75c0d5-03a3-4924-b8e8-ff4773a2725d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Request method failure captured: Sep 01 16:42:50.186615 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: request: GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 HTTP/1.1 Sep 01 16:42:50.186615 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 01 16:42:50.186615 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 01 16:42:50.186615 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Connection: close Sep 01 16:42:50.186615 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 01 16:42:50.186615 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 01 16:42:50.186615 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Host: 10.222.0.62 Sep 01 16:42:50.186615 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 01 16:42:50.186615 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 01 16:42:50.186615 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjEN-K2rHO5_6mEnKeD6mym-6cImk-4p7IPqzSyInBRSOPCBmISrGJrS_5QzYpTocaV_mMwLwQVawcfbXpZhhqNsVfiWomgC95jI-4zuabKHIyiZRHL4hHml7yhd0haaFIfMKUTx3oGMWDfNuCY-ZQIqb2HF_tuMUs4l2bPvDV6iovGYI Sep 01 16:42:50.186615 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 01 16:42:50.186615 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 01 16:42:50.186615 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 01 16:42:50.186615 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 01 16:42:50.186615 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 01 16:42:50.186615 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 01 16:42:50.186615 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Id: af2ea34aea99498eb36647be71aec5e8 Sep 01 16:42:50.186615 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-AttachVolumeTestJSON-471958966 Sep 01 16:42:50.186615 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 01 16:42:50.186615 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 01 16:42:50.188668 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/af2ea34aea99498eb36647be71aec5e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/af2ea34aea99498eb36647be71aec5e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_af2ea34aea99498eb36647be71aec5e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/af2ea34aea99498eb36647be71aec5e8"}]}] Sep 01 16:42:50.188668 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-AttachVolumeTestJSON-471958966 Sep 01 16:42:50.188668 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Id: af2ea34aea99498eb36647be71aec5e8 Sep 01 16:42:50.188668 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-AttachVolumeTestJSON-471958966 Sep 01 16:42:50.188668 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User: tempest-AttachVolumeTestJSON-471958966-project Sep 01 16:42:50.188668 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 01 16:42:50.188668 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 01 16:42:50.188668 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Id: 2c1c3f8f28b147fc838533baf62b72af Sep 01 16:42:50.188668 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-AttachVolumeTestJSON-471958966-project Sep 01 16:42:50.188668 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: method: > Sep 01 16:42:50.188668 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: exception: Instance a1bf96dd-b79a-403b-aa81-985c692df037 could not be found. Sep 01 16:42:50.188668 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: action_args: {'id': 'a1bf96dd-b79a-403b-aa81-985c692df037'} Sep 01 16:42:50.189642 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:42:50.189642 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:50.189642 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:42:50.189642 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:42:50.189642 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:42:50.189642 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:42:50.189642 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:42:50.189642 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:42:50.189642 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:42:50.189642 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:42:50.189642 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1bf96dd-b79a-403b-aa81-985c692df037 could not be found. Sep 01 16:42:50.189642 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:42:50.189642 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:50.189642 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:42:50.189642 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:50.189642 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:50.189642 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:50.189642 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:42:50.189642 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:42:50.189642 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:42:50.191006 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:42:50.191006 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:42:50.191006 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:42:50.191006 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:42:50.191006 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:42:50.191006 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:42:50.191006 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:42:50.191006 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1bf96dd-b79a-403b-aa81-985c692df037 could not be found. Sep 01 16:42:50.191006 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:42:50.191006 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:50.191006 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:42:50.191006 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:50.191006 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:50.191006 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:50.191006 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:42:50.191006 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:42:50.191006 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1bf96dd-b79a-403b-aa81-985c692df037 could not be found. Sep 01 16:42:50.191006 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:42:50.192273 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-aa75c0d5-03a3-4924-b8e8-ff4773a2725d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] Returning 404 to user: Instance a1bf96dd-b79a-403b-aa81-985c692df037 could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:42:50.192273 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-aa75c0d5-03a3-4924-b8e8-ff4773a2725d tempest-AttachVolumeTestJSON-471958966 tempest-AttachVolumeTestJSON-471958966-project] 10.222.0.62 "GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037" status: 404 len: 111 microversion: 2.1 time: 0.032747 Sep 01 16:42:50.192273 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 444/861] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:50 2022] GET /compute/v2.1/servers/a1bf96dd-b79a-403b-aa81-985c692df037 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:42:50.238009 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e10e8491-4e59-490c-ae14-d4d0501478fd tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:50.249819 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e10e8491-4e59-490c-ae14-d4d0501478fd tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956" status: 200 len: 1679 microversion: 2.1 time: 0.196057 Sep 01 16:42:50.250387 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 418/862] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:50 2022] GET /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956 => generated 1679 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:51.271922 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-9524efd8-3dd3-4d43-9d99-48b24b2978af tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:51.272595 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-9524efd8-3dd3-4d43-9d99-48b24b2978af tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: cd88a09b-04d0-4c19-b78e-cedce17f0956] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:51.275087 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=46 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:51.281252 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9524efd8-3dd3-4d43-9d99-48b24b2978af tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:51.281734 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9524efd8-3dd3-4d43-9d99-48b24b2978af tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:51.282163 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9524efd8-3dd3-4d43-9d99-48b24b2978af tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:51.282860 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9524efd8-3dd3-4d43-9d99-48b24b2978af tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:51.283302 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9524efd8-3dd3-4d43-9d99-48b24b2978af tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:51.283714 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9524efd8-3dd3-4d43-9d99-48b24b2978af tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:51.614465 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-9524efd8-3dd3-4d43-9d99-48b24b2978af tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:51.623253 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-9524efd8-3dd3-4d43-9d99-48b24b2978af tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956" status: 200 len: 1679 microversion: 2.1 time: 0.355043 Sep 01 16:42:51.624194 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 445/863] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:51 2022] GET /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956 => generated 1679 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:52.284147 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-395af720-f091-4619-8d4a-e7ece75f9e4e req-9ae66f94-34b3-49f8-a14d-6fb07955d291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd88a09b-04d0-4c19-b78e-cedce17f0956", "name": "network-vif-deleted", "tag": "7796cb2a-2d4a-4d32-86e4-943b86e85759"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:42:52.327236 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-395af720-f091-4619-8d4a-e7ece75f9e4e req-9ae66f94-34b3-49f8-a14d-6fb07955d291 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:52.328788 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-395af720-f091-4619-8d4a-e7ece75f9e4e req-9ae66f94-34b3-49f8-a14d-6fb07955d291 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:52.330668 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-395af720-f091-4619-8d4a-e7ece75f9e4e req-9ae66f94-34b3-49f8-a14d-6fb07955d291 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:52.358246 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-395af720-f091-4619-8d4a-e7ece75f9e4e req-9ae66f94-34b3-49f8-a14d-6fb07955d291 service nova] Creating event network-vif-deleted:7796cb2a-2d4a-4d32-86e4-943b86e85759 for instance cd88a09b-04d0-4c19-b78e-cedce17f0956 on hv-cinder-85221 Sep 01 16:42:52.364533 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-395af720-f091-4619-8d4a-e7ece75f9e4e req-9ae66f94-34b3-49f8-a14d-6fb07955d291 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094238 Sep 01 16:42:52.366126 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 419/864] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:42:52.659504 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-f1bc5da7-72b5-4f02-8673-1e293c15990d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:52.660224 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-f1bc5da7-72b5-4f02-8673-1e293c15990d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: cd88a09b-04d0-4c19-b78e-cedce17f0956] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:52.667082 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f1bc5da7-72b5-4f02-8673-1e293c15990d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:52.667627 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f1bc5da7-72b5-4f02-8673-1e293c15990d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:52.668261 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f1bc5da7-72b5-4f02-8673-1e293c15990d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:52.669152 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f1bc5da7-72b5-4f02-8673-1e293c15990d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:52.669740 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f1bc5da7-72b5-4f02-8673-1e293c15990d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:52.670162 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f1bc5da7-72b5-4f02-8673-1e293c15990d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:52.708648 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f1bc5da7-72b5-4f02-8673-1e293c15990d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:52.708648 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f1bc5da7-72b5-4f02-8673-1e293c15990d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:52.709008 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f1bc5da7-72b5-4f02-8673-1e293c15990d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:52.709644 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.objects.instance [None req-f1bc5da7-72b5-4f02-8673-1e293c15990d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lazy-loading 'fault' on Instance uuid cd88a09b-04d0-4c19-b78e-cedce17f0956 {{(pid=127199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:42:52.777178 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-f1bc5da7-72b5-4f02-8673-1e293c15990d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a9b222396b1438f9fa0af0e197a9293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eb3ba21eae45898f42f3456591591e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:52.785933 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-f1bc5da7-72b5-4f02-8673-1e293c15990d tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956" status: 200 len: 1329 microversion: 2.1 time: 0.130529 Sep 01 16:42:52.786977 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 446/865] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:52 2022] GET /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956 => generated 1329 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:53.810922 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3508c447-97e9-43a4-b512-7df20d34264e tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:53.811652 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-3508c447-97e9-43a4-b512-7df20d34264e tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: cd88a09b-04d0-4c19-b78e-cedce17f0956] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:53.819024 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3508c447-97e9-43a4-b512-7df20d34264e tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:53.819526 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3508c447-97e9-43a4-b512-7df20d34264e tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:53.820050 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3508c447-97e9-43a4-b512-7df20d34264e tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:53.820811 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3508c447-97e9-43a4-b512-7df20d34264e tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:53.821376 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3508c447-97e9-43a4-b512-7df20d34264e tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:53.821812 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3508c447-97e9-43a4-b512-7df20d34264e tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:53.836847 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-3508c447-97e9-43a4-b512-7df20d34264e tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] HTTP exception thrown: Instance cd88a09b-04d0-4c19-b78e-cedce17f0956 could not be found. Sep 01 16:42:53.839239 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3508c447-97e9-43a4-b512-7df20d34264e tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Request method failure captured: Sep 01 16:42:53.839239 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956 HTTP/1.1 Sep 01 16:42:53.839239 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 01 16:42:53.839239 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 01 16:42:53.839239 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Connection: close Sep 01 16:42:53.839239 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 01 16:42:53.839239 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 01 16:42:53.839239 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Host: 10.222.0.62 Sep 01 16:42:53.839239 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 01 16:42:53.839239 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 01 16:42:53.839239 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjEN-Kf91-eSEr2HhmjJIIgtYULBlBY-_2maPsbMdhNYFHSV_2GN_ZKS8U6xUKw2g04Iz3Qw_Xw-tS9eWLaTCLiW-EojfuMRS-R2za92DHQcsAGlHP3o3mR6IH5zGmVt2sA1DmWsxd2yJWFWJwD0x6dDi28dXP3yLWa_ynp6SafwxV-ns Sep 01 16:42:53.839239 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 01 16:42:53.839239 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 01 16:42:53.839239 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 01 16:42:53.839239 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 01 16:42:53.839239 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 01 16:42:53.839239 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 01 16:42:53.839239 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Id: c6eb3ba21eae45898f42f3456591591e Sep 01 16:42:53.839239 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-AttachVolumeNegativeTest-1769141885 Sep 01 16:42:53.839239 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 01 16:42:53.839239 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 01 16:42:53.840945 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c6eb3ba21eae45898f42f3456591591e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c6eb3ba21eae45898f42f3456591591e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c6eb3ba21eae45898f42f3456591591e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c6eb3ba21eae45898f42f3456591591e"}]}] Sep 01 16:42:53.840945 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-AttachVolumeNegativeTest-1769141885 Sep 01 16:42:53.840945 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Id: c6eb3ba21eae45898f42f3456591591e Sep 01 16:42:53.840945 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1769141885 Sep 01 16:42:53.840945 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User: tempest-AttachVolumeNegativeTest-1769141885-project Sep 01 16:42:53.840945 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 01 16:42:53.840945 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 01 16:42:53.840945 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Id: 3a9b222396b1438f9fa0af0e197a9293 Sep 01 16:42:53.840945 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-AttachVolumeNegativeTest-1769141885-project Sep 01 16:42:53.840945 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: method: > Sep 01 16:42:53.840945 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: exception: Instance cd88a09b-04d0-4c19-b78e-cedce17f0956 could not be found. Sep 01 16:42:53.840945 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: action_args: {'id': 'cd88a09b-04d0-4c19-b78e-cedce17f0956'} Sep 01 16:42:53.845578 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:42:53.845578 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:53.845578 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:42:53.845578 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:42:53.845578 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:42:53.845578 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:42:53.845578 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:42:53.845578 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:42:53.845578 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:42:53.845578 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:42:53.845578 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd88a09b-04d0-4c19-b78e-cedce17f0956 could not be found. Sep 01 16:42:53.845578 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:42:53.845578 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:53.845578 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:42:53.845578 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:53.845578 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:53.845578 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:53.845578 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:42:53.845578 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:42:53.845578 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:42:53.847169 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:42:53.847169 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:42:53.847169 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:42:53.847169 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:42:53.847169 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:42:53.847169 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:42:53.847169 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:42:53.847169 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd88a09b-04d0-4c19-b78e-cedce17f0956 could not be found. Sep 01 16:42:53.847169 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:42:53.847169 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:53.847169 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:42:53.847169 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:53.847169 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:53.847169 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:53.847169 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:42:53.847169 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:42:53.847169 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd88a09b-04d0-4c19-b78e-cedce17f0956 could not be found. Sep 01 16:42:53.847169 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:42:53.849676 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3508c447-97e9-43a4-b512-7df20d34264e tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Returning 404 to user: Instance cd88a09b-04d0-4c19-b78e-cedce17f0956 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:42:53.849676 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3508c447-97e9-43a4-b512-7df20d34264e tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956" status: 404 len: 111 microversion: 2.1 time: 0.034202 Sep 01 16:42:53.849676 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 420/866] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:53 2022] GET /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:42:53.850693 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b8d8f643-d1db-419e-a4ae-8a06f3566427 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '.version_select at 0x7f948223bee0>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:53.872507 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-b8d8f643-d1db-419e-a4ae-8a06f3566427 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-64666956" status: 202 len: 0 microversion: 2.1 time: 0.026344 Sep 01 16:42:53.873100 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 447/867] 10.222.0.62 () {58 vars in 1215 bytes} [Thu Sep 1 16:42:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-64666956 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:42:55.818885 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-eb174004-7e39-4db6-84be-686688e33654 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:55.819417 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-eb174004-7e39-4db6-84be-686688e33654 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: cd88a09b-04d0-4c19-b78e-cedce17f0956] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:55.827061 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eb174004-7e39-4db6-84be-686688e33654 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:55.827622 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eb174004-7e39-4db6-84be-686688e33654 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:55.828170 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eb174004-7e39-4db6-84be-686688e33654 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:55.828865 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eb174004-7e39-4db6-84be-686688e33654 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:55.829308 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eb174004-7e39-4db6-84be-686688e33654 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:55.829728 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eb174004-7e39-4db6-84be-686688e33654 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:55.844544 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-eb174004-7e39-4db6-84be-686688e33654 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] HTTP exception thrown: Instance cd88a09b-04d0-4c19-b78e-cedce17f0956 could not be found. Sep 01 16:42:55.846066 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-eb174004-7e39-4db6-84be-686688e33654 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Request method failure captured: Sep 01 16:42:55.846066 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: request: DELETE /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956 HTTP/1.1 Sep 01 16:42:55.846066 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 01 16:42:55.846066 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 01 16:42:55.846066 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Connection: close Sep 01 16:42:55.846066 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 01 16:42:55.846066 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 01 16:42:55.846066 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Host: 10.222.0.62 Sep 01 16:42:55.846066 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 01 16:42:55.846066 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 01 16:42:55.846066 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjEN-Kf91-eSEr2HhmjJIIgtYULBlBY-_2maPsbMdhNYFHSV_2GN_ZKS8U6xUKw2g04Iz3Qw_Xw-tS9eWLaTCLiW-EojfuMRS-R2za92DHQcsAGlHP3o3mR6IH5zGmVt2sA1DmWsxd2yJWFWJwD0x6dDi28dXP3yLWa_ynp6SafwxV-ns Sep 01 16:42:55.846066 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 01 16:42:55.846066 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 01 16:42:55.846066 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 01 16:42:55.846066 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 01 16:42:55.846066 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 01 16:42:55.846066 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 01 16:42:55.846066 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Id: c6eb3ba21eae45898f42f3456591591e Sep 01 16:42:55.846066 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-AttachVolumeNegativeTest-1769141885 Sep 01 16:42:55.846066 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 01 16:42:55.846066 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 01 16:42:55.847400 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c6eb3ba21eae45898f42f3456591591e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c6eb3ba21eae45898f42f3456591591e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c6eb3ba21eae45898f42f3456591591e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c6eb3ba21eae45898f42f3456591591e"}]}] Sep 01 16:42:55.847400 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-AttachVolumeNegativeTest-1769141885 Sep 01 16:42:55.847400 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Id: c6eb3ba21eae45898f42f3456591591e Sep 01 16:42:55.847400 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1769141885 Sep 01 16:42:55.847400 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User: tempest-AttachVolumeNegativeTest-1769141885-project Sep 01 16:42:55.847400 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 01 16:42:55.847400 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 01 16:42:55.847400 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Id: 3a9b222396b1438f9fa0af0e197a9293 Sep 01 16:42:55.847400 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-AttachVolumeNegativeTest-1769141885-project Sep 01 16:42:55.847400 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: method: > Sep 01 16:42:55.847400 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: exception: Instance cd88a09b-04d0-4c19-b78e-cedce17f0956 could not be found. Sep 01 16:42:55.847400 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: action_args: {'id': 'cd88a09b-04d0-4c19-b78e-cedce17f0956'} Sep 01 16:42:55.848225 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:42:55.848225 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:55.848225 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:42:55.848225 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:42:55.848225 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:42:55.848225 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:42:55.848225 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:42:55.848225 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:42:55.848225 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:42:55.848225 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:42:55.848225 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd88a09b-04d0-4c19-b78e-cedce17f0956 could not be found. Sep 01 16:42:55.848225 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:42:55.848225 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:55.848225 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:42:55.848225 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:55.848225 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:55.848225 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:55.848225 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:42:55.848225 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:42:55.848225 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:42:55.849767 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:42:55.849767 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 16:42:55.849767 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 16:42:55.849767 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 16:42:55.849767 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 16:42:55.849767 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:42:55.849767 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:42:55.849767 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:42:55.849767 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:42:55.849767 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd88a09b-04d0-4c19-b78e-cedce17f0956 could not be found. Sep 01 16:42:55.849767 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:42:55.849767 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:55.849767 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:42:55.849767 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:55.849767 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:55.849767 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:55.849767 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:42:55.849767 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:42:55.849767 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd88a09b-04d0-4c19-b78e-cedce17f0956 could not be found. Sep 01 16:42:55.849767 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:42:55.851075 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-eb174004-7e39-4db6-84be-686688e33654 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Returning 404 to user: Instance cd88a09b-04d0-4c19-b78e-cedce17f0956 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:42:55.851075 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-eb174004-7e39-4db6-84be-686688e33654 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "DELETE /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956" status: 404 len: 111 microversion: 2.1 time: 0.032477 Sep 01 16:42:55.851075 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 421/868] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Sep 1 16:42:55 2022] DELETE /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:42:55.858037 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ecf63b66-ae72-4d20-b82e-dd17904c4804 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:55.858641 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ecf63b66-ae72-4d20-b82e-dd17904c4804 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: cd88a09b-04d0-4c19-b78e-cedce17f0956] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:55.865328 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ecf63b66-ae72-4d20-b82e-dd17904c4804 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:55.865838 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ecf63b66-ae72-4d20-b82e-dd17904c4804 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:55.866295 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ecf63b66-ae72-4d20-b82e-dd17904c4804 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:55.866971 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ecf63b66-ae72-4d20-b82e-dd17904c4804 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:55.868271 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ecf63b66-ae72-4d20-b82e-dd17904c4804 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:55.868691 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ecf63b66-ae72-4d20-b82e-dd17904c4804 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:55.882986 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-ecf63b66-ae72-4d20-b82e-dd17904c4804 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] HTTP exception thrown: Instance cd88a09b-04d0-4c19-b78e-cedce17f0956 could not be found. Sep 01 16:42:55.884552 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ecf63b66-ae72-4d20-b82e-dd17904c4804 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Request method failure captured: Sep 01 16:42:55.884552 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: request: GET /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956 HTTP/1.1 Sep 01 16:42:55.884552 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 01 16:42:55.884552 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 01 16:42:55.884552 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Connection: close Sep 01 16:42:55.884552 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 01 16:42:55.884552 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 01 16:42:55.884552 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Host: 10.222.0.62 Sep 01 16:42:55.884552 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 01 16:42:55.884552 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 01 16:42:55.884552 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjEN-Kf91-eSEr2HhmjJIIgtYULBlBY-_2maPsbMdhNYFHSV_2GN_ZKS8U6xUKw2g04Iz3Qw_Xw-tS9eWLaTCLiW-EojfuMRS-R2za92DHQcsAGlHP3o3mR6IH5zGmVt2sA1DmWsxd2yJWFWJwD0x6dDi28dXP3yLWa_ynp6SafwxV-ns Sep 01 16:42:55.884552 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 01 16:42:55.884552 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 01 16:42:55.884552 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 01 16:42:55.884552 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 01 16:42:55.884552 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 01 16:42:55.884552 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 01 16:42:55.884552 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Id: c6eb3ba21eae45898f42f3456591591e Sep 01 16:42:55.884552 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-AttachVolumeNegativeTest-1769141885 Sep 01 16:42:55.884552 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 01 16:42:55.884552 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 01 16:42:55.885991 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c6eb3ba21eae45898f42f3456591591e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c6eb3ba21eae45898f42f3456591591e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c6eb3ba21eae45898f42f3456591591e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c6eb3ba21eae45898f42f3456591591e"}]}] Sep 01 16:42:55.885991 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-AttachVolumeNegativeTest-1769141885 Sep 01 16:42:55.885991 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Id: c6eb3ba21eae45898f42f3456591591e Sep 01 16:42:55.885991 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1769141885 Sep 01 16:42:55.885991 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User: tempest-AttachVolumeNegativeTest-1769141885-project Sep 01 16:42:55.885991 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 01 16:42:55.885991 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 01 16:42:55.885991 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Id: 3a9b222396b1438f9fa0af0e197a9293 Sep 01 16:42:55.885991 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-AttachVolumeNegativeTest-1769141885-project Sep 01 16:42:55.885991 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: method: > Sep 01 16:42:55.885991 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: exception: Instance cd88a09b-04d0-4c19-b78e-cedce17f0956 could not be found. Sep 01 16:42:55.885991 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: action_args: {'id': 'cd88a09b-04d0-4c19-b78e-cedce17f0956'} Sep 01 16:42:55.886886 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:42:55.886886 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:55.886886 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:42:55.886886 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:42:55.886886 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:42:55.886886 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:42:55.886886 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:42:55.886886 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:42:55.886886 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:42:55.886886 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:42:55.886886 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd88a09b-04d0-4c19-b78e-cedce17f0956 could not be found. Sep 01 16:42:55.886886 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:42:55.886886 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:55.886886 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:42:55.886886 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:55.886886 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:55.886886 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:55.886886 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:42:55.886886 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:42:55.886886 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:42:55.888428 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:42:55.888428 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:42:55.888428 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:42:55.888428 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:42:55.888428 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:42:55.888428 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:42:55.888428 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:42:55.888428 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd88a09b-04d0-4c19-b78e-cedce17f0956 could not be found. Sep 01 16:42:55.888428 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:42:55.888428 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:55.888428 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:42:55.888428 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:55.888428 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:55.888428 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:55.888428 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:42:55.888428 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:42:55.888428 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd88a09b-04d0-4c19-b78e-cedce17f0956 could not be found. Sep 01 16:42:55.888428 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:42:55.890204 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ecf63b66-ae72-4d20-b82e-dd17904c4804 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Returning 404 to user: Instance cd88a09b-04d0-4c19-b78e-cedce17f0956 could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:42:55.890204 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ecf63b66-ae72-4d20-b82e-dd17904c4804 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956" status: 404 len: 111 microversion: 2.1 time: 0.032531 Sep 01 16:42:55.890204 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 448/869] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:55 2022] GET /compute/v2.1/servers/cd88a09b-04d0-4c19-b78e-cedce17f0956 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:42:57.034537 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3f26446e-a204-4479-92a2-4886306c3bee tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:57.035067 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-3f26446e-a204-4479-92a2-4886306c3bee tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: 8055f17c-aded-4b3d-99b4-6ad010bb0e77] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:57.042171 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3f26446e-a204-4479-92a2-4886306c3bee tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:57.042536 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3f26446e-a204-4479-92a2-4886306c3bee tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:57.042989 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3f26446e-a204-4479-92a2-4886306c3bee tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:57.043694 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3f26446e-a204-4479-92a2-4886306c3bee tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:57.044190 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3f26446e-a204-4479-92a2-4886306c3bee tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:57.044636 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3f26446e-a204-4479-92a2-4886306c3bee tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:57.058436 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-3f26446e-a204-4479-92a2-4886306c3bee tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] HTTP exception thrown: Instance 8055f17c-aded-4b3d-99b4-6ad010bb0e77 could not be found. Sep 01 16:42:57.060041 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3f26446e-a204-4479-92a2-4886306c3bee tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Request method failure captured: Sep 01 16:42:57.060041 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: request: DELETE /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77 HTTP/1.1 Sep 01 16:42:57.060041 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 01 16:42:57.060041 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 01 16:42:57.060041 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Connection: close Sep 01 16:42:57.060041 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 01 16:42:57.060041 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 01 16:42:57.060041 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Host: 10.222.0.62 Sep 01 16:42:57.060041 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 01 16:42:57.060041 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 01 16:42:57.060041 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjEN-Kf91-eSEr2HhmjJIIgtYULBlBY-_2maPsbMdhNYFHSV_2GN_ZKS8U6xUKw2g04Iz3Qw_Xw-tS9eWLaTCLiW-EojfuMRS-R2za92DHQcsAGlHP3o3mR6IH5zGmVt2sA1DmWsxd2yJWFWJwD0x6dDi28dXP3yLWa_ynp6SafwxV-ns Sep 01 16:42:57.060041 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 01 16:42:57.060041 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 01 16:42:57.060041 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 01 16:42:57.060041 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 01 16:42:57.060041 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 01 16:42:57.060041 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 01 16:42:57.060041 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Id: c6eb3ba21eae45898f42f3456591591e Sep 01 16:42:57.060041 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-AttachVolumeNegativeTest-1769141885 Sep 01 16:42:57.060041 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 01 16:42:57.060041 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 01 16:42:57.061585 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c6eb3ba21eae45898f42f3456591591e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c6eb3ba21eae45898f42f3456591591e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c6eb3ba21eae45898f42f3456591591e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c6eb3ba21eae45898f42f3456591591e"}]}] Sep 01 16:42:57.061585 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-AttachVolumeNegativeTest-1769141885 Sep 01 16:42:57.061585 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Id: c6eb3ba21eae45898f42f3456591591e Sep 01 16:42:57.061585 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1769141885 Sep 01 16:42:57.061585 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User: tempest-AttachVolumeNegativeTest-1769141885-project Sep 01 16:42:57.061585 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 01 16:42:57.061585 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 01 16:42:57.061585 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Id: 3a9b222396b1438f9fa0af0e197a9293 Sep 01 16:42:57.061585 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-AttachVolumeNegativeTest-1769141885-project Sep 01 16:42:57.061585 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: method: > Sep 01 16:42:57.061585 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: exception: Instance 8055f17c-aded-4b3d-99b4-6ad010bb0e77 could not be found. Sep 01 16:42:57.061585 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: action_args: {'id': '8055f17c-aded-4b3d-99b4-6ad010bb0e77'} Sep 01 16:42:57.062368 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:42:57.062368 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:57.062368 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:42:57.062368 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:42:57.062368 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:42:57.062368 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:42:57.062368 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:42:57.062368 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:42:57.062368 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:42:57.062368 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:42:57.062368 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8055f17c-aded-4b3d-99b4-6ad010bb0e77 could not be found. Sep 01 16:42:57.062368 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:42:57.062368 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:57.062368 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:42:57.062368 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:57.062368 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:57.062368 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:57.062368 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:42:57.062368 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:42:57.062368 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:42:57.063752 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:42:57.063752 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 16:42:57.063752 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 16:42:57.063752 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 16:42:57.063752 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 16:42:57.063752 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:42:57.063752 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:42:57.063752 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:42:57.063752 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:42:57.063752 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8055f17c-aded-4b3d-99b4-6ad010bb0e77 could not be found. Sep 01 16:42:57.063752 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:42:57.063752 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:57.063752 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:42:57.063752 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:57.063752 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:57.063752 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:57.063752 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:42:57.063752 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:42:57.063752 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8055f17c-aded-4b3d-99b4-6ad010bb0e77 could not be found. Sep 01 16:42:57.063752 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:42:57.065365 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3f26446e-a204-4479-92a2-4886306c3bee tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Returning 404 to user: Instance 8055f17c-aded-4b3d-99b4-6ad010bb0e77 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:42:57.065365 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3f26446e-a204-4479-92a2-4886306c3bee tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "DELETE /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77" status: 404 len: 111 microversion: 2.1 time: 0.030876 Sep 01 16:42:57.065365 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 422/870] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Sep 1 16:42:57 2022] DELETE /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:42:57.070751 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7550df08-f7a1-430b-9217-f8b82faa59de tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:57.071398 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-7550df08-f7a1-430b-9217-f8b82faa59de tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: 8055f17c-aded-4b3d-99b4-6ad010bb0e77] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:57.078520 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7550df08-f7a1-430b-9217-f8b82faa59de tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:57.079014 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7550df08-f7a1-430b-9217-f8b82faa59de tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:57.079449 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7550df08-f7a1-430b-9217-f8b82faa59de tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:57.080232 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7550df08-f7a1-430b-9217-f8b82faa59de tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:57.080694 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7550df08-f7a1-430b-9217-f8b82faa59de tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:57.081117 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7550df08-f7a1-430b-9217-f8b82faa59de tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:57.095242 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-7550df08-f7a1-430b-9217-f8b82faa59de tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] HTTP exception thrown: Instance 8055f17c-aded-4b3d-99b4-6ad010bb0e77 could not be found. Sep 01 16:42:57.096800 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7550df08-f7a1-430b-9217-f8b82faa59de tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Request method failure captured: Sep 01 16:42:57.096800 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: request: GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77 HTTP/1.1 Sep 01 16:42:57.096800 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 01 16:42:57.096800 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 01 16:42:57.096800 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Connection: close Sep 01 16:42:57.096800 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 01 16:42:57.096800 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 01 16:42:57.096800 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Host: 10.222.0.62 Sep 01 16:42:57.096800 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 01 16:42:57.096800 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 01 16:42:57.096800 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjEN-Kf91-eSEr2HhmjJIIgtYULBlBY-_2maPsbMdhNYFHSV_2GN_ZKS8U6xUKw2g04Iz3Qw_Xw-tS9eWLaTCLiW-EojfuMRS-R2za92DHQcsAGlHP3o3mR6IH5zGmVt2sA1DmWsxd2yJWFWJwD0x6dDi28dXP3yLWa_ynp6SafwxV-ns Sep 01 16:42:57.096800 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 01 16:42:57.096800 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 01 16:42:57.096800 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 01 16:42:57.096800 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 01 16:42:57.096800 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 01 16:42:57.096800 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 01 16:42:57.096800 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Id: c6eb3ba21eae45898f42f3456591591e Sep 01 16:42:57.096800 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-AttachVolumeNegativeTest-1769141885 Sep 01 16:42:57.096800 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 01 16:42:57.096800 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 01 16:42:57.098291 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c6eb3ba21eae45898f42f3456591591e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c6eb3ba21eae45898f42f3456591591e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c6eb3ba21eae45898f42f3456591591e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c6eb3ba21eae45898f42f3456591591e"}]}] Sep 01 16:42:57.098291 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-AttachVolumeNegativeTest-1769141885 Sep 01 16:42:57.098291 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Id: c6eb3ba21eae45898f42f3456591591e Sep 01 16:42:57.098291 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1769141885 Sep 01 16:42:57.098291 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User: tempest-AttachVolumeNegativeTest-1769141885-project Sep 01 16:42:57.098291 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 01 16:42:57.098291 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 01 16:42:57.098291 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Id: 3a9b222396b1438f9fa0af0e197a9293 Sep 01 16:42:57.098291 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-AttachVolumeNegativeTest-1769141885-project Sep 01 16:42:57.098291 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: method: > Sep 01 16:42:57.098291 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: exception: Instance 8055f17c-aded-4b3d-99b4-6ad010bb0e77 could not be found. Sep 01 16:42:57.098291 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: action_args: {'id': '8055f17c-aded-4b3d-99b4-6ad010bb0e77'} Sep 01 16:42:57.099192 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:42:57.099192 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:57.099192 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:42:57.099192 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:42:57.099192 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:42:57.099192 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:42:57.099192 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:42:57.099192 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:42:57.099192 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:42:57.099192 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:42:57.099192 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8055f17c-aded-4b3d-99b4-6ad010bb0e77 could not be found. Sep 01 16:42:57.099192 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:42:57.099192 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:57.099192 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:42:57.099192 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:57.099192 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:57.099192 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:57.099192 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:42:57.099192 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:42:57.099192 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:42:57.101078 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:42:57.101078 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:42:57.101078 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:42:57.101078 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:42:57.101078 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:42:57.101078 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:42:57.101078 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:42:57.101078 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8055f17c-aded-4b3d-99b4-6ad010bb0e77 could not be found. Sep 01 16:42:57.101078 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:42:57.101078 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:57.101078 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:42:57.101078 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:57.101078 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:57.101078 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:57.101078 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:42:57.101078 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:42:57.101078 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8055f17c-aded-4b3d-99b4-6ad010bb0e77 could not be found. Sep 01 16:42:57.101078 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:42:57.102408 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7550df08-f7a1-430b-9217-f8b82faa59de tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Returning 404 to user: Instance 8055f17c-aded-4b3d-99b4-6ad010bb0e77 could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:42:57.102408 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-7550df08-f7a1-430b-9217-f8b82faa59de tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77" status: 404 len: 111 microversion: 2.1 time: 0.031599 Sep 01 16:42:57.102408 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 449/871] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:57 2022] GET /compute/v2.1/servers/8055f17c-aded-4b3d-99b4-6ad010bb0e77 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:42:57.109269 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-cf8e0341-209d-47ae-a9c3-48a7d5b9654e tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:57.109764 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-cf8e0341-209d-47ae-a9c3-48a7d5b9654e tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: c22c916b-390e-4bfe-8529-695bac5e5629] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:57.118627 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cf8e0341-209d-47ae-a9c3-48a7d5b9654e tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:57.119120 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cf8e0341-209d-47ae-a9c3-48a7d5b9654e tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:57.119604 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cf8e0341-209d-47ae-a9c3-48a7d5b9654e tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:57.121082 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cf8e0341-209d-47ae-a9c3-48a7d5b9654e tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:57.121542 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cf8e0341-209d-47ae-a9c3-48a7d5b9654e tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:57.121968 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cf8e0341-209d-47ae-a9c3-48a7d5b9654e tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:57.153510 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-cf8e0341-209d-47ae-a9c3-48a7d5b9654e tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] HTTP exception thrown: Instance c22c916b-390e-4bfe-8529-695bac5e5629 could not be found. Sep 01 16:42:57.153510 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-cf8e0341-209d-47ae-a9c3-48a7d5b9654e tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Request method failure captured: Sep 01 16:42:57.153510 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: request: DELETE /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629 HTTP/1.1 Sep 01 16:42:57.153510 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 01 16:42:57.153510 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 01 16:42:57.153510 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Connection: close Sep 01 16:42:57.153510 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 01 16:42:57.153510 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 01 16:42:57.153510 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Host: 10.222.0.62 Sep 01 16:42:57.153510 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 01 16:42:57.153510 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 01 16:42:57.153510 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjEN-Kf91-eSEr2HhmjJIIgtYULBlBY-_2maPsbMdhNYFHSV_2GN_ZKS8U6xUKw2g04Iz3Qw_Xw-tS9eWLaTCLiW-EojfuMRS-R2za92DHQcsAGlHP3o3mR6IH5zGmVt2sA1DmWsxd2yJWFWJwD0x6dDi28dXP3yLWa_ynp6SafwxV-ns Sep 01 16:42:57.153510 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 01 16:42:57.153510 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 01 16:42:57.153510 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 01 16:42:57.153510 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 01 16:42:57.153510 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 01 16:42:57.153510 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 01 16:42:57.153510 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Id: c6eb3ba21eae45898f42f3456591591e Sep 01 16:42:57.153510 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-AttachVolumeNegativeTest-1769141885 Sep 01 16:42:57.153510 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 01 16:42:57.153510 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 01 16:42:57.154954 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c6eb3ba21eae45898f42f3456591591e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c6eb3ba21eae45898f42f3456591591e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c6eb3ba21eae45898f42f3456591591e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c6eb3ba21eae45898f42f3456591591e"}]}] Sep 01 16:42:57.154954 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-AttachVolumeNegativeTest-1769141885 Sep 01 16:42:57.154954 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Id: c6eb3ba21eae45898f42f3456591591e Sep 01 16:42:57.154954 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1769141885 Sep 01 16:42:57.154954 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User: tempest-AttachVolumeNegativeTest-1769141885-project Sep 01 16:42:57.154954 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 01 16:42:57.154954 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 01 16:42:57.154954 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Id: 3a9b222396b1438f9fa0af0e197a9293 Sep 01 16:42:57.154954 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-AttachVolumeNegativeTest-1769141885-project Sep 01 16:42:57.154954 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: method: > Sep 01 16:42:57.154954 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: exception: Instance c22c916b-390e-4bfe-8529-695bac5e5629 could not be found. Sep 01 16:42:57.154954 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: action_args: {'id': 'c22c916b-390e-4bfe-8529-695bac5e5629'} Sep 01 16:42:57.155663 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:42:57.155663 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:57.155663 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:42:57.155663 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:42:57.155663 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:42:57.155663 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:42:57.155663 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:42:57.155663 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:42:57.155663 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:42:57.155663 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:42:57.155663 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c22c916b-390e-4bfe-8529-695bac5e5629 could not be found. Sep 01 16:42:57.155663 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:42:57.155663 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:57.155663 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:42:57.155663 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:57.155663 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:57.155663 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:57.155663 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:42:57.155663 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:42:57.155663 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:42:57.156937 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:42:57.156937 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 16:42:57.156937 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 16:42:57.156937 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 16:42:57.156937 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 16:42:57.156937 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:42:57.156937 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:42:57.156937 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:42:57.156937 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:42:57.156937 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c22c916b-390e-4bfe-8529-695bac5e5629 could not be found. Sep 01 16:42:57.156937 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:42:57.156937 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:57.156937 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:42:57.156937 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:57.156937 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:57.156937 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:57.156937 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:42:57.156937 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:42:57.156937 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c22c916b-390e-4bfe-8529-695bac5e5629 could not be found. Sep 01 16:42:57.156937 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:42:57.158198 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-cf8e0341-209d-47ae-a9c3-48a7d5b9654e tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Returning 404 to user: Instance c22c916b-390e-4bfe-8529-695bac5e5629 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:42:57.158198 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-cf8e0341-209d-47ae-a9c3-48a7d5b9654e tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629" status: 404 len: 111 microversion: 2.1 time: 0.047213 Sep 01 16:42:57.158198 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 423/872] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Sep 1 16:42:57 2022] DELETE /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:42:57.166878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0cbbaa2e-d286-4a7a-bef8-75b27b047206 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:57.167908 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-0cbbaa2e-d286-4a7a-bef8-75b27b047206 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: c22c916b-390e-4bfe-8529-695bac5e5629] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:57.178233 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0cbbaa2e-d286-4a7a-bef8-75b27b047206 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:57.179030 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0cbbaa2e-d286-4a7a-bef8-75b27b047206 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:57.179741 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0cbbaa2e-d286-4a7a-bef8-75b27b047206 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:57.180974 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0cbbaa2e-d286-4a7a-bef8-75b27b047206 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:57.181718 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0cbbaa2e-d286-4a7a-bef8-75b27b047206 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:57.182525 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0cbbaa2e-d286-4a7a-bef8-75b27b047206 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:57.203612 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-0cbbaa2e-d286-4a7a-bef8-75b27b047206 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] HTTP exception thrown: Instance c22c916b-390e-4bfe-8529-695bac5e5629 could not be found. Sep 01 16:42:57.205037 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0cbbaa2e-d286-4a7a-bef8-75b27b047206 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Request method failure captured: Sep 01 16:42:57.205037 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: request: GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629 HTTP/1.1 Sep 01 16:42:57.205037 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 01 16:42:57.205037 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 01 16:42:57.205037 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Connection: close Sep 01 16:42:57.205037 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 01 16:42:57.205037 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 01 16:42:57.205037 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Host: 10.222.0.62 Sep 01 16:42:57.205037 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 01 16:42:57.205037 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 01 16:42:57.205037 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjEN-Kf91-eSEr2HhmjJIIgtYULBlBY-_2maPsbMdhNYFHSV_2GN_ZKS8U6xUKw2g04Iz3Qw_Xw-tS9eWLaTCLiW-EojfuMRS-R2za92DHQcsAGlHP3o3mR6IH5zGmVt2sA1DmWsxd2yJWFWJwD0x6dDi28dXP3yLWa_ynp6SafwxV-ns Sep 01 16:42:57.205037 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 01 16:42:57.205037 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 01 16:42:57.205037 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 01 16:42:57.205037 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 01 16:42:57.205037 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 01 16:42:57.205037 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 01 16:42:57.205037 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Id: c6eb3ba21eae45898f42f3456591591e Sep 01 16:42:57.205037 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-AttachVolumeNegativeTest-1769141885 Sep 01 16:42:57.205037 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 01 16:42:57.205037 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 01 16:42:57.206657 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c6eb3ba21eae45898f42f3456591591e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c6eb3ba21eae45898f42f3456591591e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c6eb3ba21eae45898f42f3456591591e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c6eb3ba21eae45898f42f3456591591e"}]}] Sep 01 16:42:57.206657 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-AttachVolumeNegativeTest-1769141885 Sep 01 16:42:57.206657 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Id: c6eb3ba21eae45898f42f3456591591e Sep 01 16:42:57.206657 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1769141885 Sep 01 16:42:57.206657 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User: tempest-AttachVolumeNegativeTest-1769141885-project Sep 01 16:42:57.206657 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 01 16:42:57.206657 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 01 16:42:57.206657 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Id: 3a9b222396b1438f9fa0af0e197a9293 Sep 01 16:42:57.206657 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-AttachVolumeNegativeTest-1769141885-project Sep 01 16:42:57.206657 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: method: > Sep 01 16:42:57.206657 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: exception: Instance c22c916b-390e-4bfe-8529-695bac5e5629 could not be found. Sep 01 16:42:57.206657 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: action_args: {'id': 'c22c916b-390e-4bfe-8529-695bac5e5629'} Sep 01 16:42:57.207847 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:42:57.207847 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:57.207847 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:42:57.207847 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:42:57.207847 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:42:57.207847 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:42:57.207847 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:42:57.207847 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:42:57.207847 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:42:57.207847 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:42:57.207847 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c22c916b-390e-4bfe-8529-695bac5e5629 could not be found. Sep 01 16:42:57.207847 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:42:57.207847 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:57.207847 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:42:57.207847 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:57.207847 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:57.207847 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:57.207847 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:42:57.207847 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:42:57.207847 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:42:57.209476 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:42:57.209476 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:42:57.209476 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:42:57.209476 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:42:57.209476 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:42:57.209476 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:42:57.209476 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:42:57.209476 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c22c916b-390e-4bfe-8529-695bac5e5629 could not be found. Sep 01 16:42:57.209476 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:42:57.209476 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:57.209476 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:42:57.209476 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:57.209476 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:57.209476 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:57.209476 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:42:57.209476 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:42:57.209476 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c22c916b-390e-4bfe-8529-695bac5e5629 could not be found. Sep 01 16:42:57.209476 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:42:57.211090 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0cbbaa2e-d286-4a7a-bef8-75b27b047206 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Returning 404 to user: Instance c22c916b-390e-4bfe-8529-695bac5e5629 could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:42:57.211090 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-0cbbaa2e-d286-4a7a-bef8-75b27b047206 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629" status: 404 len: 111 microversion: 2.1 time: 0.046541 Sep 01 16:42:57.211090 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 450/873] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:57 2022] GET /compute/v2.1/servers/c22c916b-390e-4bfe-8529-695bac5e5629 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:42:58.362647 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1246e999-f939-4005-b284-090e800b792f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:58.363251 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1246e999-f939-4005-b284-090e800b792f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: b16ceffd-c9b2-49e6-a44d-7353a17f230a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:58.370316 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1246e999-f939-4005-b284-090e800b792f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:58.370818 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1246e999-f939-4005-b284-090e800b792f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:58.371249 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1246e999-f939-4005-b284-090e800b792f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:58.372028 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1246e999-f939-4005-b284-090e800b792f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:58.372520 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1246e999-f939-4005-b284-090e800b792f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:58.373631 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1246e999-f939-4005-b284-090e800b792f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:58.388256 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-1246e999-f939-4005-b284-090e800b792f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] HTTP exception thrown: Instance b16ceffd-c9b2-49e6-a44d-7353a17f230a could not be found. Sep 01 16:42:58.389860 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1246e999-f939-4005-b284-090e800b792f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Request method failure captured: Sep 01 16:42:58.389860 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: request: DELETE /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a HTTP/1.1 Sep 01 16:42:58.389860 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 01 16:42:58.389860 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 01 16:42:58.389860 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Connection: close Sep 01 16:42:58.389860 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 01 16:42:58.389860 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 01 16:42:58.389860 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Host: 10.222.0.62 Sep 01 16:42:58.389860 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 01 16:42:58.389860 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 01 16:42:58.389860 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjEN-Kf91-eSEr2HhmjJIIgtYULBlBY-_2maPsbMdhNYFHSV_2GN_ZKS8U6xUKw2g04Iz3Qw_Xw-tS9eWLaTCLiW-EojfuMRS-R2za92DHQcsAGlHP3o3mR6IH5zGmVt2sA1DmWsxd2yJWFWJwD0x6dDi28dXP3yLWa_ynp6SafwxV-ns Sep 01 16:42:58.389860 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 01 16:42:58.389860 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 01 16:42:58.389860 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 01 16:42:58.389860 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 01 16:42:58.389860 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 01 16:42:58.389860 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 01 16:42:58.389860 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Id: c6eb3ba21eae45898f42f3456591591e Sep 01 16:42:58.389860 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-AttachVolumeNegativeTest-1769141885 Sep 01 16:42:58.389860 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 01 16:42:58.389860 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 01 16:42:58.391330 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c6eb3ba21eae45898f42f3456591591e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c6eb3ba21eae45898f42f3456591591e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c6eb3ba21eae45898f42f3456591591e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c6eb3ba21eae45898f42f3456591591e"}]}] Sep 01 16:42:58.391330 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-AttachVolumeNegativeTest-1769141885 Sep 01 16:42:58.391330 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Id: c6eb3ba21eae45898f42f3456591591e Sep 01 16:42:58.391330 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1769141885 Sep 01 16:42:58.391330 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User: tempest-AttachVolumeNegativeTest-1769141885-project Sep 01 16:42:58.391330 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 01 16:42:58.391330 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 01 16:42:58.391330 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Id: 3a9b222396b1438f9fa0af0e197a9293 Sep 01 16:42:58.391330 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-AttachVolumeNegativeTest-1769141885-project Sep 01 16:42:58.391330 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: method: > Sep 01 16:42:58.391330 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: exception: Instance b16ceffd-c9b2-49e6-a44d-7353a17f230a could not be found. Sep 01 16:42:58.391330 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: action_args: {'id': 'b16ceffd-c9b2-49e6-a44d-7353a17f230a'} Sep 01 16:42:58.392123 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:42:58.392123 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:58.392123 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:42:58.392123 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:42:58.392123 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:42:58.392123 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:42:58.392123 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:42:58.392123 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:42:58.392123 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:42:58.392123 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:42:58.392123 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b16ceffd-c9b2-49e6-a44d-7353a17f230a could not be found. Sep 01 16:42:58.392123 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:42:58.392123 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:58.392123 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:42:58.392123 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:58.392123 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:58.392123 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:58.392123 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:42:58.392123 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:42:58.392123 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:42:58.393385 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:42:58.393385 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 16:42:58.393385 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 16:42:58.393385 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 16:42:58.393385 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 16:42:58.393385 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:42:58.393385 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:42:58.393385 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:42:58.393385 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:42:58.393385 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b16ceffd-c9b2-49e6-a44d-7353a17f230a could not be found. Sep 01 16:42:58.393385 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:42:58.393385 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:58.393385 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:42:58.393385 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:58.393385 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:58.393385 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:58.393385 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:42:58.393385 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:42:58.393385 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b16ceffd-c9b2-49e6-a44d-7353a17f230a could not be found. Sep 01 16:42:58.393385 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:42:58.394705 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1246e999-f939-4005-b284-090e800b792f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Returning 404 to user: Instance b16ceffd-c9b2-49e6-a44d-7353a17f230a could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:42:58.394705 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1246e999-f939-4005-b284-090e800b792f tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "DELETE /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a" status: 404 len: 111 microversion: 2.1 time: 0.032558 Sep 01 16:42:58.394705 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 424/874] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Sep 1 16:42:58 2022] DELETE /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:42:58.400550 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-533f4abe-01a2-4095-8df5-0b04b5c94211 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:58.401216 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-533f4abe-01a2-4095-8df5-0b04b5c94211 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] [instance: b16ceffd-c9b2-49e6-a44d-7353a17f230a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:58.407987 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-533f4abe-01a2-4095-8df5-0b04b5c94211 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:58.408480 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-533f4abe-01a2-4095-8df5-0b04b5c94211 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:58.408915 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-533f4abe-01a2-4095-8df5-0b04b5c94211 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:58.409620 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-533f4abe-01a2-4095-8df5-0b04b5c94211 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:58.410073 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-533f4abe-01a2-4095-8df5-0b04b5c94211 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:58.410491 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-533f4abe-01a2-4095-8df5-0b04b5c94211 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:58.425465 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-533f4abe-01a2-4095-8df5-0b04b5c94211 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] HTTP exception thrown: Instance b16ceffd-c9b2-49e6-a44d-7353a17f230a could not be found. Sep 01 16:42:58.426990 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-533f4abe-01a2-4095-8df5-0b04b5c94211 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Request method failure captured: Sep 01 16:42:58.426990 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: request: GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a HTTP/1.1 Sep 01 16:42:58.426990 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 01 16:42:58.426990 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 01 16:42:58.426990 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Connection: close Sep 01 16:42:58.426990 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 01 16:42:58.426990 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 01 16:42:58.426990 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Host: 10.222.0.62 Sep 01 16:42:58.426990 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 01 16:42:58.426990 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 01 16:42:58.426990 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjEN-Kf91-eSEr2HhmjJIIgtYULBlBY-_2maPsbMdhNYFHSV_2GN_ZKS8U6xUKw2g04Iz3Qw_Xw-tS9eWLaTCLiW-EojfuMRS-R2za92DHQcsAGlHP3o3mR6IH5zGmVt2sA1DmWsxd2yJWFWJwD0x6dDi28dXP3yLWa_ynp6SafwxV-ns Sep 01 16:42:58.426990 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 01 16:42:58.426990 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 01 16:42:58.426990 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 01 16:42:58.426990 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 01 16:42:58.426990 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 01 16:42:58.426990 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 01 16:42:58.426990 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Id: c6eb3ba21eae45898f42f3456591591e Sep 01 16:42:58.426990 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-AttachVolumeNegativeTest-1769141885 Sep 01 16:42:58.426990 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 01 16:42:58.426990 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 01 16:42:58.428762 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c6eb3ba21eae45898f42f3456591591e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c6eb3ba21eae45898f42f3456591591e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c6eb3ba21eae45898f42f3456591591e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c6eb3ba21eae45898f42f3456591591e"}]}] Sep 01 16:42:58.428762 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-AttachVolumeNegativeTest-1769141885 Sep 01 16:42:58.428762 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Id: c6eb3ba21eae45898f42f3456591591e Sep 01 16:42:58.428762 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1769141885 Sep 01 16:42:58.428762 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User: tempest-AttachVolumeNegativeTest-1769141885-project Sep 01 16:42:58.428762 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 01 16:42:58.428762 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 01 16:42:58.428762 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Id: 3a9b222396b1438f9fa0af0e197a9293 Sep 01 16:42:58.428762 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-AttachVolumeNegativeTest-1769141885-project Sep 01 16:42:58.428762 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: method: > Sep 01 16:42:58.428762 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: exception: Instance b16ceffd-c9b2-49e6-a44d-7353a17f230a could not be found. Sep 01 16:42:58.428762 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: action_args: {'id': 'b16ceffd-c9b2-49e6-a44d-7353a17f230a'} Sep 01 16:42:58.429669 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:42:58.429669 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:58.429669 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:42:58.429669 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:42:58.429669 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:42:58.429669 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:42:58.429669 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:42:58.429669 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:42:58.429669 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:42:58.429669 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:42:58.429669 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b16ceffd-c9b2-49e6-a44d-7353a17f230a could not be found. Sep 01 16:42:58.429669 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:42:58.429669 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:58.429669 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:42:58.429669 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:58.429669 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:58.429669 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:58.429669 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:42:58.429669 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:42:58.429669 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:42:58.431774 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:42:58.431774 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:42:58.431774 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:42:58.431774 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:42:58.431774 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:42:58.431774 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:42:58.431774 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:42:58.431774 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b16ceffd-c9b2-49e6-a44d-7353a17f230a could not be found. Sep 01 16:42:58.431774 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:42:58.431774 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:58.431774 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:42:58.431774 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:58.431774 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:58.431774 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:58.431774 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:42:58.431774 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:42:58.431774 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b16ceffd-c9b2-49e6-a44d-7353a17f230a could not be found. Sep 01 16:42:58.431774 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:42:58.434426 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-533f4abe-01a2-4095-8df5-0b04b5c94211 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] Returning 404 to user: Instance b16ceffd-c9b2-49e6-a44d-7353a17f230a could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:42:58.434426 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-533f4abe-01a2-4095-8df5-0b04b5c94211 tempest-AttachVolumeNegativeTest-1769141885 tempest-AttachVolumeNegativeTest-1769141885-project] 10.222.0.62 "GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a" status: 404 len: 111 microversion: 2.1 time: 0.032331 Sep 01 16:42:58.434426 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 451/875] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:58 2022] GET /compute/v2.1/servers/b16ceffd-c9b2-49e6-a44d-7353a17f230a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:43:09.859498 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-0ff2a5f5-1b67-4702-94f2-759ad45ad268 req-9f2ebc66-7fde-40b9-b7ef-413e71a54f52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca59565d-e140-4bf0-9ef3-9cc18f4d3068", "tag": "c9213b9e-d8d2-4cdc-b268-1f9f700f72ec"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:43:09.861194 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-524e0e58-ac6b-4a50-81d6-b4f5355ebc70 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:09.861888 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-524e0e58-ac6b-4a50-81d6-b4f5355ebc70 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:09.866444 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:09.867174 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:09.871345 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:09.873430 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-0ff2a5f5-1b67-4702-94f2-759ad45ad268 req-9f2ebc66-7fde-40b9-b7ef-413e71a54f52 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:09.874142 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-0ff2a5f5-1b67-4702-94f2-759ad45ad268 req-9f2ebc66-7fde-40b9-b7ef-413e71a54f52 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:09.874396 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=15 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:09.875134 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-0ff2a5f5-1b67-4702-94f2-759ad45ad268 req-9f2ebc66-7fde-40b9-b7ef-413e71a54f52 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:09.876877 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-524e0e58-ac6b-4a50-81d6-b4f5355ebc70 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:09.877422 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-524e0e58-ac6b-4a50-81d6-b4f5355ebc70 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:09.877952 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-524e0e58-ac6b-4a50-81d6-b4f5355ebc70 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:09.879062 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-524e0e58-ac6b-4a50-81d6-b4f5355ebc70 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:09.879689 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-524e0e58-ac6b-4a50-81d6-b4f5355ebc70 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:09.880414 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-524e0e58-ac6b-4a50-81d6-b4f5355ebc70 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:09.892813 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-0ff2a5f5-1b67-4702-94f2-759ad45ad268 req-9f2ebc66-7fde-40b9-b7ef-413e71a54f52 service nova] Creating event network-changed:c9213b9e-d8d2-4cdc-b268-1f9f700f72ec for instance ca59565d-e140-4bf0-9ef3-9cc18f4d3068 on hv-cinder-85221 Sep 01 16:43:09.898820 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-0ff2a5f5-1b67-4702-94f2-759ad45ad268 req-9f2ebc66-7fde-40b9-b7ef-413e71a54f52 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042715 Sep 01 16:43:09.904381 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 452/876] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:43:09.928783 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-524e0e58-ac6b-4a50-81d6-b4f5355ebc70 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Going to try to terminate instance {{(pid=127198) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:43:10.045272 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-524e0e58-ac6b-4a50-81d6-b4f5355ebc70 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 204 len: 0 microversion: 2.1 time: 0.188989 Sep 01 16:43:10.047338 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 425/877] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Sep 1 16:43:09 2022] DELETE /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:43:10.061663 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c5652814-fa6b-42b0-b44f-eee279f197a5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:10.072195 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-c5652814-fa6b-42b0-b44f-eee279f197a5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:10.084564 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c5652814-fa6b-42b0-b44f-eee279f197a5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:10.085669 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c5652814-fa6b-42b0-b44f-eee279f197a5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:10.086640 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c5652814-fa6b-42b0-b44f-eee279f197a5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:10.088212 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c5652814-fa6b-42b0-b44f-eee279f197a5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:10.089252 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c5652814-fa6b-42b0-b44f-eee279f197a5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:10.090243 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c5652814-fa6b-42b0-b44f-eee279f197a5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:10.334563 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c5652814-fa6b-42b0-b44f-eee279f197a5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:10.348874 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-c5652814-fa6b-42b0-b44f-eee279f197a5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1568 microversion: 2.1 time: 0.294207 Sep 01 16:43:10.365353 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 453/878] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:10 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1568 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:43:11.395223 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-546bcf3b-f580-4f77-a060-824da99e66c4 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:11.396622 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-546bcf3b-f580-4f77-a060-824da99e66c4 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:11.413379 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-546bcf3b-f580-4f77-a060-824da99e66c4 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:11.414799 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-546bcf3b-f580-4f77-a060-824da99e66c4 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:11.416729 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-546bcf3b-f580-4f77-a060-824da99e66c4 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:11.418505 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-546bcf3b-f580-4f77-a060-824da99e66c4 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:11.419470 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-546bcf3b-f580-4f77-a060-824da99e66c4 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:11.421818 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-546bcf3b-f580-4f77-a060-824da99e66c4 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:11.870707 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-546bcf3b-f580-4f77-a060-824da99e66c4 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:11.881974 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-546bcf3b-f580-4f77-a060-824da99e66c4 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1568 microversion: 2.1 time: 0.495834 Sep 01 16:43:11.896185 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 426/879] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:11 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1568 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:12.470364 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-f0515886-f8f4-43aa-8d7d-972b3b429479 req-29fc38fe-4cc6-47c9-9a96-7b7666fce52d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca59565d-e140-4bf0-9ef3-9cc18f4d3068", "name": "network-vif-deleted", "tag": "c9213b9e-d8d2-4cdc-b268-1f9f700f72ec"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:43:12.502536 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-f0515886-f8f4-43aa-8d7d-972b3b429479 req-29fc38fe-4cc6-47c9-9a96-7b7666fce52d service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:12.503285 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-f0515886-f8f4-43aa-8d7d-972b3b429479 req-29fc38fe-4cc6-47c9-9a96-7b7666fce52d service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:12.504488 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-f0515886-f8f4-43aa-8d7d-972b3b429479 req-29fc38fe-4cc6-47c9-9a96-7b7666fce52d service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:12.534849 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-f0515886-f8f4-43aa-8d7d-972b3b429479 req-29fc38fe-4cc6-47c9-9a96-7b7666fce52d service nova] Creating event network-vif-deleted:c9213b9e-d8d2-4cdc-b268-1f9f700f72ec for instance ca59565d-e140-4bf0-9ef3-9cc18f4d3068 on hv-cinder-85221 Sep 01 16:43:12.550062 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-f0515886-f8f4-43aa-8d7d-972b3b429479 req-29fc38fe-4cc6-47c9-9a96-7b7666fce52d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086991 Sep 01 16:43:12.552004 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 454/880] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:43:12.909861 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a5ed7a49-6bb5-47e5-b702-b18ba1303047 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:12.911573 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a5ed7a49-6bb5-47e5-b702-b18ba1303047 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:12.923547 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a5ed7a49-6bb5-47e5-b702-b18ba1303047 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:12.924105 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a5ed7a49-6bb5-47e5-b702-b18ba1303047 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:12.924546 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a5ed7a49-6bb5-47e5-b702-b18ba1303047 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:12.925455 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a5ed7a49-6bb5-47e5-b702-b18ba1303047 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:12.926229 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a5ed7a49-6bb5-47e5-b702-b18ba1303047 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:12.926823 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a5ed7a49-6bb5-47e5-b702-b18ba1303047 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:13.079162 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a5ed7a49-6bb5-47e5-b702-b18ba1303047 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da359f520a9d411eb52da5700c07f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5df463e3a1640ec8041d2b4bb6311f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:13.111062 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a5ed7a49-6bb5-47e5-b702-b18ba1303047 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 200 len: 1218 microversion: 2.1 time: 0.207667 Sep 01 16:43:13.117716 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 427/881] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:12 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 1218 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:14.136415 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7d995f86-e596-4d4e-b4cb-61be679cfe01 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:14.137875 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-7d995f86-e596-4d4e-b4cb-61be679cfe01 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] [instance: ca59565d-e140-4bf0-9ef3-9cc18f4d3068] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:14.143748 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7d995f86-e596-4d4e-b4cb-61be679cfe01 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:14.144334 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7d995f86-e596-4d4e-b4cb-61be679cfe01 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:14.144813 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7d995f86-e596-4d4e-b4cb-61be679cfe01 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:14.145650 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7d995f86-e596-4d4e-b4cb-61be679cfe01 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:14.146408 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7d995f86-e596-4d4e-b4cb-61be679cfe01 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:14.146788 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7d995f86-e596-4d4e-b4cb-61be679cfe01 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:14.163355 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-7d995f86-e596-4d4e-b4cb-61be679cfe01 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] HTTP exception thrown: Instance ca59565d-e140-4bf0-9ef3-9cc18f4d3068 could not be found. Sep 01 16:43:14.165697 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7d995f86-e596-4d4e-b4cb-61be679cfe01 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Request method failure captured: Sep 01 16:43:14.165697 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: request: GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 HTTP/1.1 Sep 01 16:43:14.165697 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 01 16:43:14.165697 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 01 16:43:14.165697 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Connection: close Sep 01 16:43:14.165697 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 01 16:43:14.165697 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 01 16:43:14.165697 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Host: 10.222.0.62 Sep 01 16:43:14.165697 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 01 16:43:14.165697 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 01 16:43:14.165697 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjEN_GKaSU0U-km4VGCKukHqSxiSvWQ65zEKsN324jvOo-LECfy2WaFHGIMPyKNqVg5QwIyZDLmkYJUxEB4YJ-olRsdd7U5xp4hn2oD4-Fn_ezP6rDhUxqVu0ViZdZzkSzbu8yR6k-Hez0DWSFM9Xy9UZXaevf2vGRnQrT1CTzlZjii0U Sep 01 16:43:14.165697 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 01 16:43:14.165697 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 01 16:43:14.165697 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 01 16:43:14.165697 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 01 16:43:14.165697 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 01 16:43:14.165697 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 01 16:43:14.165697 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Id: d5df463e3a1640ec8041d2b4bb6311f2 Sep 01 16:43:14.165697 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-TestShelveInstance-1764203934 Sep 01 16:43:14.165697 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 01 16:43:14.165697 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 01 16:43:14.167817 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d5df463e3a1640ec8041d2b4bb6311f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d5df463e3a1640ec8041d2b4bb6311f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d5df463e3a1640ec8041d2b4bb6311f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d5df463e3a1640ec8041d2b4bb6311f2"}]}] Sep 01 16:43:14.167817 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-TestShelveInstance-1764203934 Sep 01 16:43:14.167817 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Id: d5df463e3a1640ec8041d2b4bb6311f2 Sep 01 16:43:14.167817 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-TestShelveInstance-1764203934 Sep 01 16:43:14.167817 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User: tempest-TestShelveInstance-1764203934-project Sep 01 16:43:14.167817 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 01 16:43:14.167817 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 01 16:43:14.167817 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Id: da359f520a9d411eb52da5700c07f8d7 Sep 01 16:43:14.167817 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-TestShelveInstance-1764203934-project Sep 01 16:43:14.167817 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: method: > Sep 01 16:43:14.167817 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: exception: Instance ca59565d-e140-4bf0-9ef3-9cc18f4d3068 could not be found. Sep 01 16:43:14.167817 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: action_args: {'id': 'ca59565d-e140-4bf0-9ef3-9cc18f4d3068'} Sep 01 16:43:14.168878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:43:14.168878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:14.168878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:43:14.168878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:43:14.168878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:43:14.168878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:43:14.168878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:43:14.168878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:43:14.168878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:43:14.168878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:43:14.168878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca59565d-e140-4bf0-9ef3-9cc18f4d3068 could not be found. Sep 01 16:43:14.168878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:43:14.168878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:43:14.168878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:43:14.168878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:14.168878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:43:14.168878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:43:14.168878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:43:14.168878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:43:14.168878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:43:14.170086 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:43:14.170086 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:43:14.170086 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:43:14.170086 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:43:14.170086 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:43:14.170086 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:43:14.170086 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:43:14.170086 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca59565d-e140-4bf0-9ef3-9cc18f4d3068 could not be found. Sep 01 16:43:14.170086 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:43:14.170086 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:43:14.170086 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:43:14.170086 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:14.170086 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:43:14.170086 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:43:14.170086 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:43:14.170086 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:43:14.170086 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca59565d-e140-4bf0-9ef3-9cc18f4d3068 could not be found. Sep 01 16:43:14.170086 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:43:14.172457 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7d995f86-e596-4d4e-b4cb-61be679cfe01 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Returning 404 to user: Instance ca59565d-e140-4bf0-9ef3-9cc18f4d3068 could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:43:14.173538 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-7d995f86-e596-4d4e-b4cb-61be679cfe01 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068" status: 404 len: 111 microversion: 2.1 time: 0.043867 Sep 01 16:43:14.174068 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 455/882] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:14 2022] GET /compute/v2.1/servers/ca59565d-e140-4bf0-9ef3-9cc18f4d3068 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:43:14.459372 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-33855fe8-53bc-4306-bcec-c3cf696ee2b5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] Calling method '.version_select at 0x7f94822a4ee0>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:14.498622 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-33855fe8-53bc-4306-bcec-c3cf696ee2b5 tempest-TestShelveInstance-1764203934 tempest-TestShelveInstance-1764203934-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-16309676" status: 202 len: 0 microversion: 2.1 time: 0.055454 Sep 01 16:43:14.500158 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 428/883] 10.222.0.62 () {58 vars in 1248 bytes} [Thu Sep 1 16:43:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-16309676 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:43:14.949764 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e9791cbd-b086-4c7f-9a26-0ca638d8d4f9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:14.951959 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e9791cbd-b086-4c7f-9a26-0ca638d8d4f9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:14.960458 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e9791cbd-b086-4c7f-9a26-0ca638d8d4f9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:14.961176 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e9791cbd-b086-4c7f-9a26-0ca638d8d4f9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:14.961719 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e9791cbd-b086-4c7f-9a26-0ca638d8d4f9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:14.963669 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e9791cbd-b086-4c7f-9a26-0ca638d8d4f9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:14.964739 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e9791cbd-b086-4c7f-9a26-0ca638d8d4f9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:14.965880 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e9791cbd-b086-4c7f-9a26-0ca638d8d4f9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:15.050331 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e9791cbd-b086-4c7f-9a26-0ca638d8d4f9 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.104968 Sep 01 16:43:15.052022 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 456/884] 10.222.0.62 () {60 vars in 1343 bytes} [Thu Sep 1 16:43:14 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b/os-volume_attachments => generated 25 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:43:15.167989 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-df4f3352-80f3-4e5d-99a6-4cf1821eb78d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:15.168714 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-df4f3352-80f3-4e5d-99a6-4cf1821eb78d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:15.176637 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-df4f3352-80f3-4e5d-99a6-4cf1821eb78d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:15.177545 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-df4f3352-80f3-4e5d-99a6-4cf1821eb78d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:15.178187 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-df4f3352-80f3-4e5d-99a6-4cf1821eb78d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:15.179115 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-df4f3352-80f3-4e5d-99a6-4cf1821eb78d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:15.179581 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-df4f3352-80f3-4e5d-99a6-4cf1821eb78d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:15.180183 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-df4f3352-80f3-4e5d-99a6-4cf1821eb78d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:15.224279 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-df4f3352-80f3-4e5d-99a6-4cf1821eb78d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Going to try to terminate instance {{(pid=127198) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:43:15.403373 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-df4f3352-80f3-4e5d-99a6-4cf1821eb78d tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 204 len: 0 microversion: 2.20 time: 0.238430 Sep 01 16:43:15.405159 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 429/885] 10.222.0.62 () {60 vars in 1280 bytes} [Thu Sep 1 16:43:15 2022] DELETE /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 16:43:15.416769 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-4773864b-5e52-4e73-9e8a-be59721e95a2 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:15.417611 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-4773864b-5e52-4e73-9e8a-be59721e95a2 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:15.424625 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4773864b-5e52-4e73-9e8a-be59721e95a2 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:15.425126 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4773864b-5e52-4e73-9e8a-be59721e95a2 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:15.425573 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4773864b-5e52-4e73-9e8a-be59721e95a2 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:15.426686 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4773864b-5e52-4e73-9e8a-be59721e95a2 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:15.428743 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4773864b-5e52-4e73-9e8a-be59721e95a2 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:15.429411 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4773864b-5e52-4e73-9e8a-be59721e95a2 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:15.685829 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-4773864b-5e52-4e73-9e8a-be59721e95a2 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:15.704052 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-4773864b-5e52-4e73-9e8a-be59721e95a2 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:15.714337 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-4773864b-5e52-4e73-9e8a-be59721e95a2 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:15.716475 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-4773864b-5e52-4e73-9e8a-be59721e95a2 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1724 microversion: 2.20 time: 0.305042 Sep 01 16:43:15.733209 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 457/886] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:15 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1724 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:43:16.746011 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2e430e52-a684-43a6-a729-99be3e881337 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:16.746724 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-2e430e52-a684-43a6-a729-99be3e881337 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:16.765234 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e430e52-a684-43a6-a729-99be3e881337 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:16.766078 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e430e52-a684-43a6-a729-99be3e881337 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:16.770880 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e430e52-a684-43a6-a729-99be3e881337 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:16.771654 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e430e52-a684-43a6-a729-99be3e881337 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:16.772174 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e430e52-a684-43a6-a729-99be3e881337 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:16.772599 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2e430e52-a684-43a6-a729-99be3e881337 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:17.267907 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2e430e52-a684-43a6-a729-99be3e881337 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:17.304906 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2e430e52-a684-43a6-a729-99be3e881337 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:17.308086 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-2e430e52-a684-43a6-a729-99be3e881337 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:17.310724 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2e430e52-a684-43a6-a729-99be3e881337 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1724 microversion: 2.20 time: 0.569299 Sep 01 16:43:17.312109 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 430/887] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:16 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1724 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:43:18.347031 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d5fd1273-2e75-4a03-ba52-61b99784fe14 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:18.348617 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d5fd1273-2e75-4a03-ba52-61b99784fe14 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:18.364977 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d5fd1273-2e75-4a03-ba52-61b99784fe14 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:18.366625 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d5fd1273-2e75-4a03-ba52-61b99784fe14 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:18.367206 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d5fd1273-2e75-4a03-ba52-61b99784fe14 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:18.368759 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d5fd1273-2e75-4a03-ba52-61b99784fe14 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:18.370231 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d5fd1273-2e75-4a03-ba52-61b99784fe14 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:18.370867 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d5fd1273-2e75-4a03-ba52-61b99784fe14 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:18.537852 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d5fd1273-2e75-4a03-ba52-61b99784fe14 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:18.588719 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d5fd1273-2e75-4a03-ba52-61b99784fe14 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:18.608408 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d5fd1273-2e75-4a03-ba52-61b99784fe14 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '849f875ede78424c81919df6d9c152dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470f32e4a954dcab3e0ccdd2736c1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:18.613199 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-c3cd60d2-d216-4436-89c9-3d0a0583cfd2 req-ecfcd599-2dda-4689-821a-7ae86ab6ebda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ae2e10f-5b22-4257-b92d-bc87e0df662b", "name": "network-vif-deleted", "tag": "eff032c5-6a93-4a57-984a-8860719c6117"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:43:18.622497 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d5fd1273-2e75-4a03-ba52-61b99784fe14 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 200 len: 1656 microversion: 2.20 time: 0.279570 Sep 01 16:43:18.626797 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 458/888] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:18 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 1656 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:43:18.662465 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-c3cd60d2-d216-4436-89c9-3d0a0583cfd2 req-ecfcd599-2dda-4689-821a-7ae86ab6ebda service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:18.669520 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-c3cd60d2-d216-4436-89c9-3d0a0583cfd2 req-ecfcd599-2dda-4689-821a-7ae86ab6ebda service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:18.687496 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-c3cd60d2-d216-4436-89c9-3d0a0583cfd2 req-ecfcd599-2dda-4689-821a-7ae86ab6ebda service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:18.751147 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-c3cd60d2-d216-4436-89c9-3d0a0583cfd2 req-ecfcd599-2dda-4689-821a-7ae86ab6ebda service nova] Creating event network-vif-deleted:eff032c5-6a93-4a57-984a-8860719c6117 for instance 0ae2e10f-5b22-4257-b92d-bc87e0df662b on hv-cinder-85221 Sep 01 16:43:18.766532 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-c3cd60d2-d216-4436-89c9-3d0a0583cfd2 req-ecfcd599-2dda-4689-821a-7ae86ab6ebda service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160202 Sep 01 16:43:18.771196 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 431/889] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:43:19.670834 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ca5efe50-f5a8-492b-b029-0e4cdea5db15 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:19.672482 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ca5efe50-f5a8-492b-b029-0e4cdea5db15 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:19.683286 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ca5efe50-f5a8-492b-b029-0e4cdea5db15 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:19.683756 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ca5efe50-f5a8-492b-b029-0e4cdea5db15 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:19.689407 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ca5efe50-f5a8-492b-b029-0e4cdea5db15 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:19.690177 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ca5efe50-f5a8-492b-b029-0e4cdea5db15 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:19.690677 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ca5efe50-f5a8-492b-b029-0e4cdea5db15 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:19.692425 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ca5efe50-f5a8-492b-b029-0e4cdea5db15 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:19.733384 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-ca5efe50-f5a8-492b-b029-0e4cdea5db15 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] HTTP exception thrown: Instance 0ae2e10f-5b22-4257-b92d-bc87e0df662b could not be found. Sep 01 16:43:19.739862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ca5efe50-f5a8-492b-b029-0e4cdea5db15 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Request method failure captured: Sep 01 16:43:19.739862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: request: GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b HTTP/1.1 Sep 01 16:43:19.739862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 01 16:43:19.739862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 01 16:43:19.739862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Connection: close Sep 01 16:43:19.739862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 01 16:43:19.739862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 01 16:43:19.739862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Host: 10.222.0.62 Sep 01 16:43:19.739862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 01 16:43:19.739862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 01 16:43:19.739862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjEN-E-s7JY0G8Q_0XlNdteecvhyJOB3R9JuSnwjbBxjqSmKnH2JgnKcxdC0KzuPvp5t_LQ7zwQRhEMvZBBZ8MNeHxomRlxn5-OfP0evxTGU8VlAW00U2H4sUxAfbZgcfD8lZz_WpNN0oNf1pKt7BLJq3oPH0SkJQenihwbo4PnCvNbAw Sep 01 16:43:19.739862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 01 16:43:19.739862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 01 16:43:19.739862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 01 16:43:19.739862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 01 16:43:19.739862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 16:43:19.739862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 01 16:43:19.739862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 01 16:43:19.739862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Id: 6470f32e4a954dcab3e0ccdd2736c1f6 Sep 01 16:43:19.739862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-257291902 Sep 01 16:43:19.739862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 01 16:43:19.739862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 01 16:43:19.741880 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6470f32e4a954dcab3e0ccdd2736c1f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/6470f32e4a954dcab3e0ccdd2736c1f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_6470f32e4a954dcab3e0ccdd2736c1f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6470f32e4a954dcab3e0ccdd2736c1f6"}]}] Sep 01 16:43:19.741880 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-AttachVolumeShelveTestJSON-257291902 Sep 01 16:43:19.741880 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Id: 6470f32e4a954dcab3e0ccdd2736c1f6 Sep 01 16:43:19.741880 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-257291902 Sep 01 16:43:19.741880 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User: tempest-AttachVolumeShelveTestJSON-257291902-project Sep 01 16:43:19.741880 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 01 16:43:19.741880 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 01 16:43:19.741880 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Id: 849f875ede78424c81919df6d9c152dd Sep 01 16:43:19.741880 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-AttachVolumeShelveTestJSON-257291902-project Sep 01 16:43:19.741880 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: method: > Sep 01 16:43:19.741880 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: exception: Instance 0ae2e10f-5b22-4257-b92d-bc87e0df662b could not be found. Sep 01 16:43:19.741880 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: action_args: {'id': '0ae2e10f-5b22-4257-b92d-bc87e0df662b'} Sep 01 16:43:19.742756 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:43:19.742756 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:19.742756 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:43:19.742756 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:43:19.742756 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:43:19.742756 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:43:19.742756 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:43:19.742756 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:43:19.742756 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:43:19.742756 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:43:19.742756 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ae2e10f-5b22-4257-b92d-bc87e0df662b could not be found. Sep 01 16:43:19.742756 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:43:19.742756 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:43:19.742756 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:43:19.742756 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:19.742756 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:43:19.742756 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:43:19.742756 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:43:19.742756 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:43:19.742756 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:43:19.746533 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:43:19.746533 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:43:19.746533 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:43:19.746533 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:43:19.746533 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:43:19.746533 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:43:19.746533 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:43:19.746533 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ae2e10f-5b22-4257-b92d-bc87e0df662b could not be found. Sep 01 16:43:19.746533 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:43:19.746533 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:43:19.746533 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:43:19.746533 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:19.746533 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:43:19.746533 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:43:19.746533 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:43:19.746533 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:43:19.746533 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ae2e10f-5b22-4257-b92d-bc87e0df662b could not be found. Sep 01 16:43:19.746533 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:43:19.750086 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ca5efe50-f5a8-492b-b029-0e4cdea5db15 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Returning 404 to user: Instance 0ae2e10f-5b22-4257-b92d-bc87e0df662b could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:43:19.750086 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ca5efe50-f5a8-492b-b029-0e4cdea5db15 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 404 len: 111 microversion: 2.20 time: 0.078006 Sep 01 16:43:19.750086 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 459/890] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:19 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 01 16:43:19.769592 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-186ec0fb-4e90-4795-b9ff-dc63ae86bbc4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '.version_select at 0x7f9482445f70>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:19.802857 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-186ec0fb-4e90-4795-b9ff-dc63ae86bbc4 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-738371928" status: 204 len: 0 microversion: 2.20 time: 0.053810 Sep 01 16:43:19.808176 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 432/891] 10.222.0.62 () {60 vars in 1259 bytes} [Thu Sep 1 16:43:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-738371928 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 16:43:23.124282 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-9206f648-e8ca-45fd-b97b-707c599f3a96 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:23.126210 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-9206f648-e8ca-45fd-b97b-707c599f3a96 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:23.152862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9206f648-e8ca-45fd-b97b-707c599f3a96 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:23.160849 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9206f648-e8ca-45fd-b97b-707c599f3a96 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:23.161724 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9206f648-e8ca-45fd-b97b-707c599f3a96 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:23.163011 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9206f648-e8ca-45fd-b97b-707c599f3a96 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:23.163911 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9206f648-e8ca-45fd-b97b-707c599f3a96 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:23.168740 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9206f648-e8ca-45fd-b97b-707c599f3a96 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:23.234801 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-9206f648-e8ca-45fd-b97b-707c599f3a96 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] HTTP exception thrown: Instance 0ae2e10f-5b22-4257-b92d-bc87e0df662b could not be found. Sep 01 16:43:23.237727 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-9206f648-e8ca-45fd-b97b-707c599f3a96 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Request method failure captured: Sep 01 16:43:23.237727 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: request: DELETE /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b HTTP/1.1 Sep 01 16:43:23.237727 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 01 16:43:23.237727 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 01 16:43:23.237727 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Connection: close Sep 01 16:43:23.237727 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 01 16:43:23.237727 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 01 16:43:23.237727 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Host: 10.222.0.62 Sep 01 16:43:23.237727 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 01 16:43:23.237727 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 01 16:43:23.237727 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjEN-E-s7JY0G8Q_0XlNdteecvhyJOB3R9JuSnwjbBxjqSmKnH2JgnKcxdC0KzuPvp5t_LQ7zwQRhEMvZBBZ8MNeHxomRlxn5-OfP0evxTGU8VlAW00U2H4sUxAfbZgcfD8lZz_WpNN0oNf1pKt7BLJq3oPH0SkJQenihwbo4PnCvNbAw Sep 01 16:43:23.237727 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 01 16:43:23.237727 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 01 16:43:23.237727 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 01 16:43:23.237727 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 01 16:43:23.237727 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 16:43:23.237727 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 01 16:43:23.237727 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 01 16:43:23.237727 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Id: 6470f32e4a954dcab3e0ccdd2736c1f6 Sep 01 16:43:23.237727 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-257291902 Sep 01 16:43:23.237727 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 01 16:43:23.237727 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 01 16:43:23.240207 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6470f32e4a954dcab3e0ccdd2736c1f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/6470f32e4a954dcab3e0ccdd2736c1f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_6470f32e4a954dcab3e0ccdd2736c1f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6470f32e4a954dcab3e0ccdd2736c1f6"}]}] Sep 01 16:43:23.240207 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-AttachVolumeShelveTestJSON-257291902 Sep 01 16:43:23.240207 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Id: 6470f32e4a954dcab3e0ccdd2736c1f6 Sep 01 16:43:23.240207 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-257291902 Sep 01 16:43:23.240207 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User: tempest-AttachVolumeShelveTestJSON-257291902-project Sep 01 16:43:23.240207 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 01 16:43:23.240207 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 01 16:43:23.240207 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Id: 849f875ede78424c81919df6d9c152dd Sep 01 16:43:23.240207 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-AttachVolumeShelveTestJSON-257291902-project Sep 01 16:43:23.240207 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: method: > Sep 01 16:43:23.240207 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: exception: Instance 0ae2e10f-5b22-4257-b92d-bc87e0df662b could not be found. Sep 01 16:43:23.240207 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: action_args: {'id': '0ae2e10f-5b22-4257-b92d-bc87e0df662b'} Sep 01 16:43:23.241793 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:43:23.241793 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:23.241793 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:43:23.241793 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:43:23.241793 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:43:23.241793 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:43:23.241793 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:43:23.241793 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:43:23.241793 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:43:23.241793 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:43:23.241793 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ae2e10f-5b22-4257-b92d-bc87e0df662b could not be found. Sep 01 16:43:23.241793 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:43:23.241793 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:43:23.241793 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:43:23.241793 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:23.241793 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:43:23.241793 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:43:23.241793 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:43:23.241793 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:43:23.241793 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:43:23.244350 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:43:23.244350 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 16:43:23.244350 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 16:43:23.244350 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 16:43:23.244350 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 16:43:23.244350 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:43:23.244350 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:43:23.244350 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:43:23.244350 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:43:23.244350 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ae2e10f-5b22-4257-b92d-bc87e0df662b could not be found. Sep 01 16:43:23.244350 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:43:23.244350 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:43:23.244350 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:43:23.244350 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:23.244350 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:43:23.244350 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:43:23.244350 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:43:23.244350 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:43:23.244350 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ae2e10f-5b22-4257-b92d-bc87e0df662b could not be found. Sep 01 16:43:23.244350 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:43:23.247160 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-9206f648-e8ca-45fd-b97b-707c599f3a96 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Returning 404 to user: Instance 0ae2e10f-5b22-4257-b92d-bc87e0df662b could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:43:23.247160 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-9206f648-e8ca-45fd-b97b-707c599f3a96 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 404 len: 111 microversion: 2.20 time: 0.125031 Sep 01 16:43:23.247160 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 460/892] 10.222.0.62 () {60 vars in 1280 bytes} [Thu Sep 1 16:43:23 2022] DELETE /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 16:43:23.259195 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0c3648e4-8c7a-40c3-bad2-7fd503e290e7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:23.261413 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0c3648e4-8c7a-40c3-bad2-7fd503e290e7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 0ae2e10f-5b22-4257-b92d-bc87e0df662b] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:23.274618 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0c3648e4-8c7a-40c3-bad2-7fd503e290e7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:23.275381 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0c3648e4-8c7a-40c3-bad2-7fd503e290e7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:23.276230 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0c3648e4-8c7a-40c3-bad2-7fd503e290e7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:23.277375 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0c3648e4-8c7a-40c3-bad2-7fd503e290e7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:23.278104 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0c3648e4-8c7a-40c3-bad2-7fd503e290e7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:23.278808 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0c3648e4-8c7a-40c3-bad2-7fd503e290e7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:23.305193 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-0c3648e4-8c7a-40c3-bad2-7fd503e290e7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] HTTP exception thrown: Instance 0ae2e10f-5b22-4257-b92d-bc87e0df662b could not be found. Sep 01 16:43:23.308101 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0c3648e4-8c7a-40c3-bad2-7fd503e290e7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Request method failure captured: Sep 01 16:43:23.308101 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b HTTP/1.1 Sep 01 16:43:23.308101 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 01 16:43:23.308101 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 01 16:43:23.308101 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Connection: close Sep 01 16:43:23.308101 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 01 16:43:23.308101 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 01 16:43:23.308101 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Host: 10.222.0.62 Sep 01 16:43:23.308101 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 01 16:43:23.308101 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 01 16:43:23.308101 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjEN-E-s7JY0G8Q_0XlNdteecvhyJOB3R9JuSnwjbBxjqSmKnH2JgnKcxdC0KzuPvp5t_LQ7zwQRhEMvZBBZ8MNeHxomRlxn5-OfP0evxTGU8VlAW00U2H4sUxAfbZgcfD8lZz_WpNN0oNf1pKt7BLJq3oPH0SkJQenihwbo4PnCvNbAw Sep 01 16:43:23.308101 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 01 16:43:23.308101 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 01 16:43:23.308101 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 01 16:43:23.308101 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 01 16:43:23.308101 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 16:43:23.308101 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 01 16:43:23.308101 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 01 16:43:23.308101 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Id: 6470f32e4a954dcab3e0ccdd2736c1f6 Sep 01 16:43:23.308101 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-257291902 Sep 01 16:43:23.308101 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 01 16:43:23.308101 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 01 16:43:23.310152 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6470f32e4a954dcab3e0ccdd2736c1f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/6470f32e4a954dcab3e0ccdd2736c1f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_6470f32e4a954dcab3e0ccdd2736c1f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6470f32e4a954dcab3e0ccdd2736c1f6"}]}] Sep 01 16:43:23.310152 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-AttachVolumeShelveTestJSON-257291902 Sep 01 16:43:23.310152 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Id: 6470f32e4a954dcab3e0ccdd2736c1f6 Sep 01 16:43:23.310152 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-257291902 Sep 01 16:43:23.310152 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User: tempest-AttachVolumeShelveTestJSON-257291902-project Sep 01 16:43:23.310152 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 01 16:43:23.310152 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 01 16:43:23.310152 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Id: 849f875ede78424c81919df6d9c152dd Sep 01 16:43:23.310152 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-AttachVolumeShelveTestJSON-257291902-project Sep 01 16:43:23.310152 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: method: > Sep 01 16:43:23.310152 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: exception: Instance 0ae2e10f-5b22-4257-b92d-bc87e0df662b could not be found. Sep 01 16:43:23.310152 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: action_args: {'id': '0ae2e10f-5b22-4257-b92d-bc87e0df662b'} Sep 01 16:43:23.311211 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:43:23.311211 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:23.311211 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:43:23.311211 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:43:23.311211 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:43:23.311211 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:43:23.311211 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:43:23.311211 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:43:23.311211 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:43:23.311211 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:43:23.311211 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ae2e10f-5b22-4257-b92d-bc87e0df662b could not be found. Sep 01 16:43:23.311211 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:43:23.311211 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:43:23.311211 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:43:23.311211 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:23.311211 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:43:23.311211 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:43:23.311211 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:43:23.311211 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:43:23.311211 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:43:23.313336 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:43:23.313336 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:43:23.313336 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:43:23.313336 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:43:23.313336 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:43:23.313336 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:43:23.313336 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:43:23.313336 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ae2e10f-5b22-4257-b92d-bc87e0df662b could not be found. Sep 01 16:43:23.313336 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:43:23.313336 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:43:23.313336 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:43:23.313336 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:23.313336 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:43:23.313336 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:43:23.313336 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:43:23.313336 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:43:23.313336 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ae2e10f-5b22-4257-b92d-bc87e0df662b could not be found. Sep 01 16:43:23.313336 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:43:23.314636 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0c3648e4-8c7a-40c3-bad2-7fd503e290e7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Returning 404 to user: Instance 0ae2e10f-5b22-4257-b92d-bc87e0df662b could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:43:23.314636 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0c3648e4-8c7a-40c3-bad2-7fd503e290e7 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b" status: 404 len: 111 microversion: 2.20 time: 0.059680 Sep 01 16:43:23.314636 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 433/893] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:23 2022] GET /compute/v2.1/servers/0ae2e10f-5b22-4257-b92d-bc87e0df662b => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 16:43:24.597038 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-5a098377-ea31-41ff-85a0-18c906be9db0 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:24.598322 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-5a098377-ea31-41ff-85a0-18c906be9db0 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:24.606213 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5a098377-ea31-41ff-85a0-18c906be9db0 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:24.606907 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5a098377-ea31-41ff-85a0-18c906be9db0 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:24.607520 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5a098377-ea31-41ff-85a0-18c906be9db0 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:24.608631 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5a098377-ea31-41ff-85a0-18c906be9db0 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:24.609336 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5a098377-ea31-41ff-85a0-18c906be9db0 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:24.609977 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5a098377-ea31-41ff-85a0-18c906be9db0 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:24.629938 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-5a098377-ea31-41ff-85a0-18c906be9db0 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] HTTP exception thrown: Instance 8ddc2614-8a62-4c61-a086-8dbab65e1f4a could not be found. Sep 01 16:43:24.631745 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-5a098377-ea31-41ff-85a0-18c906be9db0 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Request method failure captured: Sep 01 16:43:24.631745 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: request: DELETE /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a HTTP/1.1 Sep 01 16:43:24.631745 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 01 16:43:24.631745 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 01 16:43:24.631745 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Connection: close Sep 01 16:43:24.631745 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 01 16:43:24.631745 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 01 16:43:24.631745 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Host: 10.222.0.62 Sep 01 16:43:24.631745 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 01 16:43:24.631745 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 01 16:43:24.631745 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjEN-E-s7JY0G8Q_0XlNdteecvhyJOB3R9JuSnwjbBxjqSmKnH2JgnKcxdC0KzuPvp5t_LQ7zwQRhEMvZBBZ8MNeHxomRlxn5-OfP0evxTGU8VlAW00U2H4sUxAfbZgcfD8lZz_WpNN0oNf1pKt7BLJq3oPH0SkJQenihwbo4PnCvNbAw Sep 01 16:43:24.631745 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 01 16:43:24.631745 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 01 16:43:24.631745 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 01 16:43:24.631745 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 01 16:43:24.631745 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 16:43:24.631745 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 01 16:43:24.631745 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 01 16:43:24.631745 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Id: 6470f32e4a954dcab3e0ccdd2736c1f6 Sep 01 16:43:24.631745 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-257291902 Sep 01 16:43:24.631745 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 01 16:43:24.631745 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 01 16:43:24.633160 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6470f32e4a954dcab3e0ccdd2736c1f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/6470f32e4a954dcab3e0ccdd2736c1f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_6470f32e4a954dcab3e0ccdd2736c1f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6470f32e4a954dcab3e0ccdd2736c1f6"}]}] Sep 01 16:43:24.633160 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-AttachVolumeShelveTestJSON-257291902 Sep 01 16:43:24.633160 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Id: 6470f32e4a954dcab3e0ccdd2736c1f6 Sep 01 16:43:24.633160 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-257291902 Sep 01 16:43:24.633160 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User: tempest-AttachVolumeShelveTestJSON-257291902-project Sep 01 16:43:24.633160 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 01 16:43:24.633160 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 01 16:43:24.633160 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Id: 849f875ede78424c81919df6d9c152dd Sep 01 16:43:24.633160 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-AttachVolumeShelveTestJSON-257291902-project Sep 01 16:43:24.633160 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: method: > Sep 01 16:43:24.633160 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: exception: Instance 8ddc2614-8a62-4c61-a086-8dbab65e1f4a could not be found. Sep 01 16:43:24.633160 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: action_args: {'id': '8ddc2614-8a62-4c61-a086-8dbab65e1f4a'} Sep 01 16:43:24.633970 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:43:24.633970 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:24.633970 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:43:24.633970 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:43:24.633970 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:43:24.633970 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:43:24.633970 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:43:24.633970 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:43:24.633970 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:43:24.633970 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:43:24.633970 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ddc2614-8a62-4c61-a086-8dbab65e1f4a could not be found. Sep 01 16:43:24.633970 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:43:24.633970 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:43:24.633970 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:43:24.633970 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:24.633970 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:43:24.633970 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:43:24.633970 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:43:24.633970 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:43:24.633970 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:43:24.635267 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:43:24.635267 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 16:43:24.635267 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 16:43:24.635267 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 16:43:24.635267 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 16:43:24.635267 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:43:24.635267 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:43:24.635267 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:43:24.635267 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:43:24.635267 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ddc2614-8a62-4c61-a086-8dbab65e1f4a could not be found. Sep 01 16:43:24.635267 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:43:24.635267 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:43:24.635267 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:43:24.635267 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:24.635267 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:43:24.635267 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:43:24.635267 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:43:24.635267 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:43:24.635267 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ddc2614-8a62-4c61-a086-8dbab65e1f4a could not be found. Sep 01 16:43:24.635267 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:43:24.638523 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-5a098377-ea31-41ff-85a0-18c906be9db0 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Returning 404 to user: Instance 8ddc2614-8a62-4c61-a086-8dbab65e1f4a could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:43:24.639664 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-5a098377-ea31-41ff-85a0-18c906be9db0 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "DELETE /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 404 len: 111 microversion: 2.20 time: 0.046454 Sep 01 16:43:24.640795 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 461/894] 10.222.0.62 () {60 vars in 1280 bytes} [Thu Sep 1 16:43:24 2022] DELETE /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 01 16:43:24.654738 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-155e01d3-479a-4c51-8624-f3d67a46a232 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:24.656706 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-155e01d3-479a-4c51-8624-f3d67a46a232 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] [instance: 8ddc2614-8a62-4c61-a086-8dbab65e1f4a] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:24.668546 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-155e01d3-479a-4c51-8624-f3d67a46a232 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:24.669727 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-155e01d3-479a-4c51-8624-f3d67a46a232 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:24.670814 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-155e01d3-479a-4c51-8624-f3d67a46a232 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:24.672515 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-155e01d3-479a-4c51-8624-f3d67a46a232 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:24.673668 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-155e01d3-479a-4c51-8624-f3d67a46a232 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:24.674706 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-155e01d3-479a-4c51-8624-f3d67a46a232 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:24.707451 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-155e01d3-479a-4c51-8624-f3d67a46a232 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] HTTP exception thrown: Instance 8ddc2614-8a62-4c61-a086-8dbab65e1f4a could not be found. Sep 01 16:43:24.710879 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-155e01d3-479a-4c51-8624-f3d67a46a232 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Request method failure captured: Sep 01 16:43:24.710879 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a HTTP/1.1 Sep 01 16:43:24.710879 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 01 16:43:24.710879 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 01 16:43:24.710879 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Connection: close Sep 01 16:43:24.710879 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 01 16:43:24.710879 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 01 16:43:24.710879 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Host: 10.222.0.62 Sep 01 16:43:24.710879 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 01 16:43:24.710879 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 01 16:43:24.710879 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjEN-E-s7JY0G8Q_0XlNdteecvhyJOB3R9JuSnwjbBxjqSmKnH2JgnKcxdC0KzuPvp5t_LQ7zwQRhEMvZBBZ8MNeHxomRlxn5-OfP0evxTGU8VlAW00U2H4sUxAfbZgcfD8lZz_WpNN0oNf1pKt7BLJq3oPH0SkJQenihwbo4PnCvNbAw Sep 01 16:43:24.710879 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 01 16:43:24.710879 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 01 16:43:24.710879 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 01 16:43:24.710879 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 01 16:43:24.710879 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 16:43:24.710879 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 01 16:43:24.710879 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 01 16:43:24.710879 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Id: 6470f32e4a954dcab3e0ccdd2736c1f6 Sep 01 16:43:24.710879 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-257291902 Sep 01 16:43:24.710879 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 01 16:43:24.710879 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 01 16:43:24.712760 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6470f32e4a954dcab3e0ccdd2736c1f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/6470f32e4a954dcab3e0ccdd2736c1f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_6470f32e4a954dcab3e0ccdd2736c1f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6470f32e4a954dcab3e0ccdd2736c1f6"}]}] Sep 01 16:43:24.712760 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-AttachVolumeShelveTestJSON-257291902 Sep 01 16:43:24.712760 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Id: 6470f32e4a954dcab3e0ccdd2736c1f6 Sep 01 16:43:24.712760 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-257291902 Sep 01 16:43:24.712760 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User: tempest-AttachVolumeShelveTestJSON-257291902-project Sep 01 16:43:24.712760 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 01 16:43:24.712760 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 01 16:43:24.712760 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Id: 849f875ede78424c81919df6d9c152dd Sep 01 16:43:24.712760 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-AttachVolumeShelveTestJSON-257291902-project Sep 01 16:43:24.712760 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: method: > Sep 01 16:43:24.712760 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: exception: Instance 8ddc2614-8a62-4c61-a086-8dbab65e1f4a could not be found. Sep 01 16:43:24.712760 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: action_args: {'id': '8ddc2614-8a62-4c61-a086-8dbab65e1f4a'} Sep 01 16:43:24.713802 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:43:24.713802 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:24.713802 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:43:24.713802 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:43:24.713802 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:43:24.713802 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:43:24.713802 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:43:24.713802 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:43:24.713802 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:43:24.713802 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:43:24.713802 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ddc2614-8a62-4c61-a086-8dbab65e1f4a could not be found. Sep 01 16:43:24.713802 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:43:24.713802 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:43:24.713802 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:43:24.713802 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:24.713802 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:43:24.713802 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:43:24.713802 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:43:24.713802 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:43:24.713802 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:43:24.717828 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:43:24.717828 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:43:24.717828 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:43:24.717828 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:43:24.717828 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:43:24.717828 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:43:24.717828 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:43:24.717828 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ddc2614-8a62-4c61-a086-8dbab65e1f4a could not be found. Sep 01 16:43:24.717828 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:43:24.717828 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:43:24.717828 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:43:24.717828 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:24.717828 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:43:24.717828 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:43:24.717828 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:43:24.717828 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:43:24.717828 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ddc2614-8a62-4c61-a086-8dbab65e1f4a could not be found. Sep 01 16:43:24.717828 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:43:24.721892 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-155e01d3-479a-4c51-8624-f3d67a46a232 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] Returning 404 to user: Instance 8ddc2614-8a62-4c61-a086-8dbab65e1f4a could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:43:24.721892 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-155e01d3-479a-4c51-8624-f3d67a46a232 tempest-AttachVolumeShelveTestJSON-257291902 tempest-AttachVolumeShelveTestJSON-257291902-project] 10.222.0.62 "GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a" status: 404 len: 111 microversion: 2.20 time: 0.067298 Sep 01 16:43:24.721892 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 434/895] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:24 2022] GET /compute/v2.1/servers/8ddc2614-8a62-4c61-a086-8dbab65e1f4a => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 16:44:24.142437 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=20 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:24.143172 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=36 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:24.397771 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a6e4f42a-e718-4fee-a755-e8d05fa45760 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Action: 'create', calling method: .version_select at 0x7f948225c940>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1926683814", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABKLSU2Z78EXoR5cAMgPCOuwWdu1obw9EfooqVBWvo8RkiQFz+RaivyhWhAR4itMB/3bG3VVh5fp4OuuQcYJbW9cfnm5z3V12VRvT8nQQCcFd1XN9wXTck5E7jAVNoP4g=="}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:44:24.418149 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-a6e4f42a-e718-4fee-a755-e8d05fa45760 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Getting quotas for project ec4d86f1d7bc4cc9a39ff55d4dc6a801. Resources: {'key_pairs'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:44:24.423974 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-a6e4f42a-e718-4fee-a755-e8d05fa45760 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Getting quotas for user ed4710f614cc431683a9c2a4f3d9d7b6 and project ec4d86f1d7bc4cc9a39ff55d4dc6a801. Resources: {'key_pairs'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:44:24.462073 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-a6e4f42a-e718-4fee-a755-e8d05fa45760 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.320678 Sep 01 16:44:24.464264 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 462/896] 10.222.0.62 () {60 vars in 1159 bytes} [Thu Sep 1 16:44:24 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:44:28.050349 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-13d8546e-f649-4bc6-b3b7-c1251ecea1dd tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-92080735", "imageRef": "49e5276c-002c-454f-8be8-76deb18b6b28", "flavorRef": "452", "networks": [{"uuid": "5740f89c-1069-4c6a-aa8a-30161b41663c"}]}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:44:28.060040 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:28.060705 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:30.415616 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.network.neutron [None req-13d8546e-f649-4bc6-b3b7-c1251ecea1dd tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] validate_networks() for [('5740f89c-1069-4c6a-aa8a-30161b41663c', None, None, None, None, None)] {{(pid=127198) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:44:30.835194 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-13d8546e-f649-4bc6-b3b7-c1251ecea1dd tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Flavor limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:44:30.835613 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-13d8546e-f649-4bc6-b3b7-c1251ecea1dd tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Image limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:44:30.836114 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-13d8546e-f649-4bc6-b3b7-c1251ecea1dd tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Flavor pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:44:30.836518 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-13d8546e-f649-4bc6-b3b7-c1251ecea1dd tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Image pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:44:30.836923 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-13d8546e-f649-4bc6-b3b7-c1251ecea1dd tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:44:30.846650 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-13d8546e-f649-4bc6-b3b7-c1251ecea1dd tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:30.847137 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-13d8546e-f649-4bc6-b3b7-c1251ecea1dd tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:30.847573 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-13d8546e-f649-4bc6-b3b7-c1251ecea1dd tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:30.848313 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-13d8546e-f649-4bc6-b3b7-c1251ecea1dd tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:30.848765 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-13d8546e-f649-4bc6-b3b7-c1251ecea1dd tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:30.849178 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-13d8546e-f649-4bc6-b3b7-c1251ecea1dd tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:30.868215 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-13d8546e-f649-4bc6-b3b7-c1251ecea1dd tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Getting quotas for project 4ffc6ebebba5490f84b35ffb827b08d8. Resources: {'ram', 'cores', 'instances'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:44:30.872606 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-13d8546e-f649-4bc6-b3b7-c1251ecea1dd tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Getting quotas for user fd734af142f64b2db23fc59dfde2fb0e and project 4ffc6ebebba5490f84b35ffb827b08d8. Resources: {'ram', 'cores', 'instances'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:44:30.884238 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-13d8546e-f649-4bc6-b3b7-c1251ecea1dd tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Going to run 1 instances... {{(pid=127198) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:44:30.887237 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-13d8546e-f649-4bc6-b3b7-c1251ecea1dd tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [instance: ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='49e5276c-002c-454f-8be8-76deb18b6b28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:44:30.935120 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR oslo.messaging._drivers.impl_rabbit [None req-13d8546e-f649-4bc6-b3b7-c1251ecea1dd tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [cf7d5e9b-f561-46ec-a4f8-c0b991ecd7bf] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 16:44:31.946460 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO oslo.messaging._drivers.impl_rabbit [None req-13d8546e-f649-4bc6-b3b7-c1251ecea1dd tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [cf7d5e9b-f561-46ec-a4f8-c0b991ecd7bf] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 37522. Sep 01 16:44:31.951734 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-13d8546e-f649-4bc6-b3b7-c1251ecea1dd tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.906603 Sep 01 16:44:31.952520 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 435/897] 10.222.0.62 () {60 vars in 1147 bytes} [Thu Sep 1 16:44:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 3908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:44:31.965882 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-fe547d38-90a3-4f5a-98b1-263009c05dfc tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:31.967140 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-fe547d38-90a3-4f5a-98b1-263009c05dfc tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [instance: ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:32.026028 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-fe547d38-90a3-4f5a-98b1-263009c05dfc tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd734af142f64b2db23fc59dfde2fb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffc6ebebba5490f84b35ffb827b08d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:32.034792 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-fe547d38-90a3-4f5a-98b1-263009c05dfc tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] 10.222.0.62 "GET /compute/v2.1/servers/ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9" status: 200 len: 1217 microversion: 2.1 time: 0.073780 Sep 01 16:44:32.035452 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 463/898] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:31 2022] GET /compute/v2.1/servers/ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9 => generated 1217 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:33.068008 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d7c9c4da-19ef-4c0d-9dbf-344d6b8eb3eb tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:33.070641 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d7c9c4da-19ef-4c0d-9dbf-344d6b8eb3eb tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [instance: ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:33.133500 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d7c9c4da-19ef-4c0d-9dbf-344d6b8eb3eb tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd734af142f64b2db23fc59dfde2fb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffc6ebebba5490f84b35ffb827b08d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:33.140557 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d7c9c4da-19ef-4c0d-9dbf-344d6b8eb3eb tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] 10.222.0.62 "GET /compute/v2.1/servers/ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9" status: 200 len: 1217 microversion: 2.1 time: 0.083424 Sep 01 16:44:33.141132 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 436/899] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:33 2022] GET /compute/v2.1/servers/ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9 => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:34.163219 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-3d6e7523-f61e-486a-90ea-d2cb1db3e01b tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:34.163864 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-3d6e7523-f61e-486a-90ea-d2cb1db3e01b tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [instance: ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:34.224759 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-3d6e7523-f61e-486a-90ea-d2cb1db3e01b tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd734af142f64b2db23fc59dfde2fb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffc6ebebba5490f84b35ffb827b08d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:34.234973 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-3d6e7523-f61e-486a-90ea-d2cb1db3e01b tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] 10.222.0.62 "GET /compute/v2.1/servers/ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9" status: 200 len: 1217 microversion: 2.1 time: 0.075877 Sep 01 16:44:34.235565 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 464/900] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:34 2022] GET /compute/v2.1/servers/ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9 => generated 1217 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:35.262474 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0f08c0f7-0b6d-40ee-84cd-e9deb62ba70a tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:35.263058 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0f08c0f7-0b6d-40ee-84cd-e9deb62ba70a tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [instance: ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:35.325992 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0f08c0f7-0b6d-40ee-84cd-e9deb62ba70a tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd734af142f64b2db23fc59dfde2fb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffc6ebebba5490f84b35ffb827b08d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:35.352481 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0f08c0f7-0b6d-40ee-84cd-e9deb62ba70a tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] 10.222.0.62 "GET /compute/v2.1/servers/ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9" status: 200 len: 1217 microversion: 2.1 time: 0.086418 Sep 01 16:44:35.366476 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 437/901] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:35 2022] GET /compute/v2.1/servers/ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9 => generated 1217 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:36.378429 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-5e8d57c4-f5a3-47a6-97ce-a0247405b0b9 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:36.378976 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-5e8d57c4-f5a3-47a6-97ce-a0247405b0b9 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [instance: ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:36.386576 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5e8d57c4-f5a3-47a6-97ce-a0247405b0b9 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:36.387067 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5e8d57c4-f5a3-47a6-97ce-a0247405b0b9 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:36.387504 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5e8d57c4-f5a3-47a6-97ce-a0247405b0b9 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:36.388244 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5e8d57c4-f5a3-47a6-97ce-a0247405b0b9 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:36.388703 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5e8d57c4-f5a3-47a6-97ce-a0247405b0b9 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:36.389133 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5e8d57c4-f5a3-47a6-97ce-a0247405b0b9 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:36.462031 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-5e8d57c4-f5a3-47a6-97ce-a0247405b0b9 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd734af142f64b2db23fc59dfde2fb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffc6ebebba5490f84b35ffb827b08d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:36.470058 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-5e8d57c4-f5a3-47a6-97ce-a0247405b0b9 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] 10.222.0.62 "GET /compute/v2.1/servers/ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9" status: 200 len: 1221 microversion: 2.1 time: 0.095591 Sep 01 16:44:36.470743 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 465/902] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:36 2022] GET /compute/v2.1/servers/ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9 => generated 1221 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:37.492164 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7b625926-9e74-4293-ba2a-155ebea37c85 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:37.492951 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7b625926-9e74-4293-ba2a-155ebea37c85 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [instance: ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:37.500106 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b625926-9e74-4293-ba2a-155ebea37c85 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:37.500596 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b625926-9e74-4293-ba2a-155ebea37c85 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:37.501032 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b625926-9e74-4293-ba2a-155ebea37c85 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:37.501741 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b625926-9e74-4293-ba2a-155ebea37c85 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:37.502189 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b625926-9e74-4293-ba2a-155ebea37c85 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:37.503134 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7b625926-9e74-4293-ba2a-155ebea37c85 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:37.614125 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7b625926-9e74-4293-ba2a-155ebea37c85 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd734af142f64b2db23fc59dfde2fb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffc6ebebba5490f84b35ffb827b08d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:37.622758 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7b625926-9e74-4293-ba2a-155ebea37c85 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] 10.222.0.62 "GET /compute/v2.1/servers/ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9" status: 200 len: 1269 microversion: 2.1 time: 0.134838 Sep 01 16:44:37.632629 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 438/903] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:37 2022] GET /compute/v2.1/servers/ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9 => generated 1269 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:38.642988 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8f3339fc-a5eb-4a81-a180-82c0e2d35f27 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:38.644353 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-8f3339fc-a5eb-4a81-a180-82c0e2d35f27 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [instance: ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:38.653442 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8f3339fc-a5eb-4a81-a180-82c0e2d35f27 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:38.654205 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8f3339fc-a5eb-4a81-a180-82c0e2d35f27 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:38.654948 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8f3339fc-a5eb-4a81-a180-82c0e2d35f27 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:38.656011 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8f3339fc-a5eb-4a81-a180-82c0e2d35f27 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:38.656690 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8f3339fc-a5eb-4a81-a180-82c0e2d35f27 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:38.657495 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8f3339fc-a5eb-4a81-a180-82c0e2d35f27 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:38.928842 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8f3339fc-a5eb-4a81-a180-82c0e2d35f27 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd734af142f64b2db23fc59dfde2fb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffc6ebebba5490f84b35ffb827b08d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:38.938898 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8f3339fc-a5eb-4a81-a180-82c0e2d35f27 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] 10.222.0.62 "GET /compute/v2.1/servers/ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9" status: 200 len: 1317 microversion: 2.1 time: 0.299826 Sep 01 16:44:38.939486 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 466/904] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:38 2022] GET /compute/v2.1/servers/ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9 => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:39.200135 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-fd97cc59-22f1-437a-b5a8-062332f3fdbf req-30bd8295-8ffd-473f-bfb2-a4989e96d9f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9", "tag": "3906c04a-0949-4ced-9606-334bfcf57b78"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:44:39.211628 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-fd97cc59-22f1-437a-b5a8-062332f3fdbf req-30bd8295-8ffd-473f-bfb2-a4989e96d9f7 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:39.212049 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-fd97cc59-22f1-437a-b5a8-062332f3fdbf req-30bd8295-8ffd-473f-bfb2-a4989e96d9f7 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:39.212506 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-fd97cc59-22f1-437a-b5a8-062332f3fdbf req-30bd8295-8ffd-473f-bfb2-a4989e96d9f7 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:39.227532 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-fd97cc59-22f1-437a-b5a8-062332f3fdbf req-30bd8295-8ffd-473f-bfb2-a4989e96d9f7 service nova] Creating event network-changed:3906c04a-0949-4ced-9606-334bfcf57b78 for instance ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9 on hv-cinder-85221 Sep 01 16:44:39.233552 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-fd97cc59-22f1-437a-b5a8-062332f3fdbf req-30bd8295-8ffd-473f-bfb2-a4989e96d9f7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039631 Sep 01 16:44:39.234301 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 439/905] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:44:39.962302 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a5441a40-8f25-4689-a70a-44ac420e359f tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:39.962981 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-a5441a40-8f25-4689-a70a-44ac420e359f tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [instance: ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:39.970272 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a5441a40-8f25-4689-a70a-44ac420e359f tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:39.970844 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a5441a40-8f25-4689-a70a-44ac420e359f tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:39.971313 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a5441a40-8f25-4689-a70a-44ac420e359f tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:39.972091 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a5441a40-8f25-4689-a70a-44ac420e359f tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:39.972626 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a5441a40-8f25-4689-a70a-44ac420e359f tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:39.973038 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a5441a40-8f25-4689-a70a-44ac420e359f tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:40.226550 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-a5441a40-8f25-4689-a70a-44ac420e359f tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd734af142f64b2db23fc59dfde2fb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffc6ebebba5490f84b35ffb827b08d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:40.237755 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-a5441a40-8f25-4689-a70a-44ac420e359f tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] 10.222.0.62 "GET /compute/v2.1/servers/ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9" status: 200 len: 1317 microversion: 2.1 time: 0.279658 Sep 01 16:44:40.238395 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 467/906] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:39 2022] GET /compute/v2.1/servers/ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9 => generated 1317 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:41.257058 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:41.262643 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5f14916e-f479-4ad9-a43a-cb6b2e6c2694 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:41.263243 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5f14916e-f479-4ad9-a43a-cb6b2e6c2694 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [instance: ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:41.270126 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5f14916e-f479-4ad9-a43a-cb6b2e6c2694 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:41.270609 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5f14916e-f479-4ad9-a43a-cb6b2e6c2694 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:41.271049 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5f14916e-f479-4ad9-a43a-cb6b2e6c2694 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:41.271748 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5f14916e-f479-4ad9-a43a-cb6b2e6c2694 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:41.272242 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5f14916e-f479-4ad9-a43a-cb6b2e6c2694 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:41.272677 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5f14916e-f479-4ad9-a43a-cb6b2e6c2694 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:41.435846 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5f14916e-f479-4ad9-a43a-cb6b2e6c2694 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd734af142f64b2db23fc59dfde2fb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffc6ebebba5490f84b35ffb827b08d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:41.444889 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5f14916e-f479-4ad9-a43a-cb6b2e6c2694 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] 10.222.0.62 "GET /compute/v2.1/servers/ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9" status: 200 len: 1317 microversion: 2.1 time: 0.189295 Sep 01 16:44:41.445619 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 440/907] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:41 2022] GET /compute/v2.1/servers/ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9 => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:42.470826 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-fe70793d-84ec-4fd8-9596-48e12a5282c6 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:42.471728 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-fe70793d-84ec-4fd8-9596-48e12a5282c6 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [instance: ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:42.478962 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fe70793d-84ec-4fd8-9596-48e12a5282c6 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:42.480981 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fe70793d-84ec-4fd8-9596-48e12a5282c6 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:42.480981 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fe70793d-84ec-4fd8-9596-48e12a5282c6 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:42.480981 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fe70793d-84ec-4fd8-9596-48e12a5282c6 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:42.482828 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fe70793d-84ec-4fd8-9596-48e12a5282c6 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:42.482828 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fe70793d-84ec-4fd8-9596-48e12a5282c6 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:42.713622 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-fe70793d-84ec-4fd8-9596-48e12a5282c6 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd734af142f64b2db23fc59dfde2fb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffc6ebebba5490f84b35ffb827b08d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:42.725930 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-fe70793d-84ec-4fd8-9596-48e12a5282c6 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] 10.222.0.62 "GET /compute/v2.1/servers/ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9" status: 200 len: 1317 microversion: 2.1 time: 0.261671 Sep 01 16:44:42.726796 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 468/908] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:42 2022] GET /compute/v2.1/servers/ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9 => generated 1317 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:43.160029 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-efbacb21-1a75-47bb-b118-863b39d030d7 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1925255575", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1926683814", "security_groups": [{"name": "tempest-secgroup-smoke-505739473"}], "block_device_mapping_v2": [{"uuid": "7dd96d4f-a09d-4c32-bb0c-168256237f37", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d4d42d28-c5d6-49fb-b45c-004cc9c36c1c"}]}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:44:43.282397 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.network.neutron [None req-efbacb21-1a75-47bb-b118-863b39d030d7 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] validate_networks() for [('d4d42d28-c5d6-49fb-b45c-004cc9c36c1c', None, None, None, None, None)] {{(pid=127198) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:44:43.723524 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-efbacb21-1a75-47bb-b118-863b39d030d7 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Flavor limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:44:43.724172 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-efbacb21-1a75-47bb-b118-863b39d030d7 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Image limits 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:44:43.724873 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-efbacb21-1a75-47bb-b118-863b39d030d7 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Flavor pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:44:43.725579 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-efbacb21-1a75-47bb-b118-863b39d030d7 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Image pref 0:0:0 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:44:43.726059 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.virt.hardware [None req-efbacb21-1a75-47bb-b118-863b39d030d7 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:44:43.736060 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-efbacb21-1a75-47bb-b118-863b39d030d7 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:43.736551 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-efbacb21-1a75-47bb-b118-863b39d030d7 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:43.737025 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-efbacb21-1a75-47bb-b118-863b39d030d7 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:43.737744 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-efbacb21-1a75-47bb-b118-863b39d030d7 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:43.738198 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-efbacb21-1a75-47bb-b118-863b39d030d7 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:43.738620 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-efbacb21-1a75-47bb-b118-863b39d030d7 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:43.756554 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a36641c4-ff25-48e7-875f-920a4e8a04e5 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:43.757517 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-efbacb21-1a75-47bb-b118-863b39d030d7 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Getting quotas for project ec4d86f1d7bc4cc9a39ff55d4dc6a801. Resources: {'ram', 'cores', 'instances'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:44:43.761689 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-a36641c4-ff25-48e7-875f-920a4e8a04e5 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [instance: ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:43.764054 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-efbacb21-1a75-47bb-b118-863b39d030d7 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Getting quotas for user ed4710f614cc431683a9c2a4f3d9d7b6 and project ec4d86f1d7bc4cc9a39ff55d4dc6a801. Resources: {'ram', 'cores', 'instances'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:44:43.772085 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a36641c4-ff25-48e7-875f-920a4e8a04e5 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:43.772812 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a36641c4-ff25-48e7-875f-920a4e8a04e5 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:43.773616 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a36641c4-ff25-48e7-875f-920a4e8a04e5 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:43.774845 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a36641c4-ff25-48e7-875f-920a4e8a04e5 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:43.775534 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a36641c4-ff25-48e7-875f-920a4e8a04e5 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:43.776218 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a36641c4-ff25-48e7-875f-920a4e8a04e5 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:43.839864 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-efbacb21-1a75-47bb-b118-863b39d030d7 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Going to run 1 instances... {{(pid=127198) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:44:43.842086 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-efbacb21-1a75-47bb-b118-863b39d030d7 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 267fca3e-c9de-44ba-a888-8443d96fc9c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7dd96d4f-a09d-4c32-bb0c-168256237f37',volume_size=None,volume_type=None)] {{(pid=127198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:44:43.944408 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-a36641c4-ff25-48e7-875f-920a4e8a04e5 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd734af142f64b2db23fc59dfde2fb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffc6ebebba5490f84b35ffb827b08d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:43.956057 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-a36641c4-ff25-48e7-875f-920a4e8a04e5 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] 10.222.0.62 "GET /compute/v2.1/servers/ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9" status: 200 len: 1317 microversion: 2.1 time: 0.205847 Sep 01 16:44:43.956669 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 469/909] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:43 2022] GET /compute/v2.1/servers/ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9 => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:44.007414 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-efbacb21-1a75-47bb-b118-863b39d030d7 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.850860 Sep 01 16:44:44.009434 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 441/910] 10.222.0.62 () {60 vars in 1147 bytes} [Thu Sep 1 16:44:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:44:44.025235 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-2528bf7e-c59c-4e5a-ac2b-554b342b9ac5 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:44.026494 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-2528bf7e-c59c-4e5a-ac2b-554b342b9ac5 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 267fca3e-c9de-44ba-a888-8443d96fc9c8] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:44.098384 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-2528bf7e-c59c-4e5a-ac2b-554b342b9ac5 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:44.109639 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-2528bf7e-c59c-4e5a-ac2b-554b342b9ac5 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8" status: 200 len: 1095 microversion: 2.1 time: 0.092316 Sep 01 16:44:44.110792 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 470/911] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:44 2022] GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8 => generated 1095 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:44.326931 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-8f8e2ae6-959f-4570-b020-6d0dd78b0d7e req-88901bda-9f4d-4eaa-ac48-d2ef260030b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9", "name": "network-vif-plugged", "status": "completed", "tag": "3906c04a-0949-4ced-9606-334bfcf57b78"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:44:44.337938 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-8f8e2ae6-959f-4570-b020-6d0dd78b0d7e req-88901bda-9f4d-4eaa-ac48-d2ef260030b4 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:44.338521 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-8f8e2ae6-959f-4570-b020-6d0dd78b0d7e req-88901bda-9f4d-4eaa-ac48-d2ef260030b4 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:44.338885 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-8f8e2ae6-959f-4570-b020-6d0dd78b0d7e req-88901bda-9f4d-4eaa-ac48-d2ef260030b4 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:44.352840 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-8f8e2ae6-959f-4570-b020-6d0dd78b0d7e req-88901bda-9f4d-4eaa-ac48-d2ef260030b4 service nova] Creating event network-vif-plugged:3906c04a-0949-4ced-9606-334bfcf57b78 for instance ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9 on hv-cinder-85221 Sep 01 16:44:44.357943 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-8f8e2ae6-959f-4570-b020-6d0dd78b0d7e req-88901bda-9f4d-4eaa-ac48-d2ef260030b4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034890 Sep 01 16:44:44.358751 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 442/912] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:44:44.982240 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-28ffaf80-ed90-4236-9f8a-387c3baf0698 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:44.983063 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-28ffaf80-ed90-4236-9f8a-387c3baf0698 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [instance: ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:44.990985 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-28ffaf80-ed90-4236-9f8a-387c3baf0698 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:44.991476 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-28ffaf80-ed90-4236-9f8a-387c3baf0698 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:44.991921 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-28ffaf80-ed90-4236-9f8a-387c3baf0698 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:44.992591 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-28ffaf80-ed90-4236-9f8a-387c3baf0698 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:44.993071 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-28ffaf80-ed90-4236-9f8a-387c3baf0698 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:44.993587 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-28ffaf80-ed90-4236-9f8a-387c3baf0698 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:45.132822 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-245f1290-6481-4107-ae03-676814bbb78b tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:45.133946 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-245f1290-6481-4107-ae03-676814bbb78b tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 267fca3e-c9de-44ba-a888-8443d96fc9c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:45.136410 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-28ffaf80-ed90-4236-9f8a-387c3baf0698 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd734af142f64b2db23fc59dfde2fb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffc6ebebba5490f84b35ffb827b08d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:45.145042 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-28ffaf80-ed90-4236-9f8a-387c3baf0698 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] 10.222.0.62 "GET /compute/v2.1/servers/ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9" status: 200 len: 1317 microversion: 2.1 time: 0.168658 Sep 01 16:44:45.145492 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 471/913] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:44 2022] GET /compute/v2.1/servers/ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:45.201660 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-245f1290-6481-4107-ae03-676814bbb78b tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:45.209926 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-245f1290-6481-4107-ae03-676814bbb78b tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8" status: 200 len: 1095 microversion: 2.1 time: 0.081595 Sep 01 16:44:45.210512 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 443/914] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:45 2022] GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8 => generated 1095 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:46.168574 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-20840032-e2dd-445d-834c-132c8d477084 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:46.169551 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-20840032-e2dd-445d-834c-132c8d477084 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [instance: ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:46.176899 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-20840032-e2dd-445d-834c-132c8d477084 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:46.177687 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-20840032-e2dd-445d-834c-132c8d477084 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:46.177878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-20840032-e2dd-445d-834c-132c8d477084 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:46.178435 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-20840032-e2dd-445d-834c-132c8d477084 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:46.179034 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-20840032-e2dd-445d-834c-132c8d477084 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:46.179603 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-20840032-e2dd-445d-834c-132c8d477084 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:46.230628 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0afd50e8-0189-4a28-baa0-5a9717c3bf20 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:46.231507 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0afd50e8-0189-4a28-baa0-5a9717c3bf20 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 267fca3e-c9de-44ba-a888-8443d96fc9c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:46.301117 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0afd50e8-0189-4a28-baa0-5a9717c3bf20 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:46.310810 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0afd50e8-0189-4a28-baa0-5a9717c3bf20 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8" status: 200 len: 1095 microversion: 2.1 time: 0.083850 Sep 01 16:44:46.311656 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 444/915] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:46 2022] GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8 => generated 1095 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:44:46.372389 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-20840032-e2dd-445d-834c-132c8d477084 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd734af142f64b2db23fc59dfde2fb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffc6ebebba5490f84b35ffb827b08d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:46.380714 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-20840032-e2dd-445d-834c-132c8d477084 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] 10.222.0.62 "GET /compute/v2.1/servers/ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9" status: 200 len: 1506 microversion: 2.1 time: 0.218033 Sep 01 16:44:46.381306 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 472/916] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:46 2022] GET /compute/v2.1/servers/ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9 => generated 1506 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:47.337935 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-137dcb78-dc0c-40bf-82a8-df6b32ff413e tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:47.338682 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-137dcb78-dc0c-40bf-82a8-df6b32ff413e tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 267fca3e-c9de-44ba-a888-8443d96fc9c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:47.401079 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-137dcb78-dc0c-40bf-82a8-df6b32ff413e tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:47.410334 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-137dcb78-dc0c-40bf-82a8-df6b32ff413e tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8" status: 200 len: 1095 microversion: 2.1 time: 0.081498 Sep 01 16:44:47.411481 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 445/917] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:47 2022] GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8 => generated 1095 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:48.438609 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-bdc4be10-da5a-44a9-8c46-8b50f72a1825 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:48.439849 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-bdc4be10-da5a-44a9-8c46-8b50f72a1825 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 267fca3e-c9de-44ba-a888-8443d96fc9c8] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:48.447607 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bdc4be10-da5a-44a9-8c46-8b50f72a1825 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:48.448144 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bdc4be10-da5a-44a9-8c46-8b50f72a1825 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:48.448577 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bdc4be10-da5a-44a9-8c46-8b50f72a1825 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:48.449280 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bdc4be10-da5a-44a9-8c46-8b50f72a1825 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:48.449725 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bdc4be10-da5a-44a9-8c46-8b50f72a1825 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:48.450146 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bdc4be10-da5a-44a9-8c46-8b50f72a1825 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:48.522882 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-bdc4be10-da5a-44a9-8c46-8b50f72a1825 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:48.534132 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-bdc4be10-da5a-44a9-8c46-8b50f72a1825 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8" status: 200 len: 1145 microversion: 2.1 time: 0.104162 Sep 01 16:44:48.535023 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 473/918] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:48 2022] GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8 => generated 1145 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:49.556473 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ba72f647-28d0-45f3-9973-07f313cf0a6f tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:49.557120 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ba72f647-28d0-45f3-9973-07f313cf0a6f tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 267fca3e-c9de-44ba-a888-8443d96fc9c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:49.567920 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ba72f647-28d0-45f3-9973-07f313cf0a6f tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:49.567920 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ba72f647-28d0-45f3-9973-07f313cf0a6f tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:49.567920 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ba72f647-28d0-45f3-9973-07f313cf0a6f tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:49.569340 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ba72f647-28d0-45f3-9973-07f313cf0a6f tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:49.570160 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ba72f647-28d0-45f3-9973-07f313cf0a6f tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:49.570770 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ba72f647-28d0-45f3-9973-07f313cf0a6f tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:49.664009 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ba72f647-28d0-45f3-9973-07f313cf0a6f tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:49.674582 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ba72f647-28d0-45f3-9973-07f313cf0a6f tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8" status: 200 len: 1211 microversion: 2.1 time: 0.122266 Sep 01 16:44:49.694000 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 446/919] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:49 2022] GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8 => generated 1211 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:50.703708 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-fb0f095e-3e0e-4658-b4dc-c7bc872c4a63 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:50.704360 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-fb0f095e-3e0e-4658-b4dc-c7bc872c4a63 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 267fca3e-c9de-44ba-a888-8443d96fc9c8] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:50.711735 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fb0f095e-3e0e-4658-b4dc-c7bc872c4a63 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:50.712034 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fb0f095e-3e0e-4658-b4dc-c7bc872c4a63 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:50.712517 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fb0f095e-3e0e-4658-b4dc-c7bc872c4a63 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:50.713214 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fb0f095e-3e0e-4658-b4dc-c7bc872c4a63 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:50.713667 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fb0f095e-3e0e-4658-b4dc-c7bc872c4a63 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:50.714092 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fb0f095e-3e0e-4658-b4dc-c7bc872c4a63 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:50.916037 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-fb0f095e-3e0e-4658-b4dc-c7bc872c4a63 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:50.928902 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-fb0f095e-3e0e-4658-b4dc-c7bc872c4a63 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8" status: 200 len: 1266 microversion: 2.1 time: 0.229405 Sep 01 16:44:50.929544 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 474/920] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:50 2022] GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8 => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:50.956625 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-9698f75a-81e3-4106-ab3a-bb72291514a0 req-b9707e39-f0b9-43d0-a84d-2ba3640bf4f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "267fca3e-c9de-44ba-a888-8443d96fc9c8", "tag": "7eec2532-2b18-4d3f-93b9-c8294bd927c2"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:44:50.974940 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-9698f75a-81e3-4106-ab3a-bb72291514a0 req-b9707e39-f0b9-43d0-a84d-2ba3640bf4f4 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:50.976223 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-9698f75a-81e3-4106-ab3a-bb72291514a0 req-b9707e39-f0b9-43d0-a84d-2ba3640bf4f4 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:50.977060 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-9698f75a-81e3-4106-ab3a-bb72291514a0 req-b9707e39-f0b9-43d0-a84d-2ba3640bf4f4 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:50.996611 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-9698f75a-81e3-4106-ab3a-bb72291514a0 req-b9707e39-f0b9-43d0-a84d-2ba3640bf4f4 service nova] Creating event network-changed:7eec2532-2b18-4d3f-93b9-c8294bd927c2 for instance 267fca3e-c9de-44ba-a888-8443d96fc9c8 on hv-cinder-85221 Sep 01 16:44:51.002387 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-9698f75a-81e3-4106-ab3a-bb72291514a0 req-b9707e39-f0b9-43d0-a84d-2ba3640bf4f4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051889 Sep 01 16:44:51.003253 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 447/921] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:44:51.951949 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-5c47d2d2-7a87-4142-a6d1-a12c57da5c1f tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:51.952775 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-5c47d2d2-7a87-4142-a6d1-a12c57da5c1f tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 267fca3e-c9de-44ba-a888-8443d96fc9c8] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:51.959550 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5c47d2d2-7a87-4142-a6d1-a12c57da5c1f tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:51.960091 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5c47d2d2-7a87-4142-a6d1-a12c57da5c1f tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:51.960558 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5c47d2d2-7a87-4142-a6d1-a12c57da5c1f tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:51.961340 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5c47d2d2-7a87-4142-a6d1-a12c57da5c1f tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:51.961828 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5c47d2d2-7a87-4142-a6d1-a12c57da5c1f tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:51.962266 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5c47d2d2-7a87-4142-a6d1-a12c57da5c1f tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:52.230394 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-5c47d2d2-7a87-4142-a6d1-a12c57da5c1f tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:52.239459 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-5c47d2d2-7a87-4142-a6d1-a12c57da5c1f tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8" status: 200 len: 1266 microversion: 2.1 time: 0.291807 Sep 01 16:44:52.240162 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 475/922] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:51 2022] GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8 => generated 1266 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:53.275154 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-cc718b7d-dec3-48bf-8b6b-e752b2a03ae7 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:53.275856 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-cc718b7d-dec3-48bf-8b6b-e752b2a03ae7 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 267fca3e-c9de-44ba-a888-8443d96fc9c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:53.285548 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cc718b7d-dec3-48bf-8b6b-e752b2a03ae7 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:53.286035 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cc718b7d-dec3-48bf-8b6b-e752b2a03ae7 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:53.286492 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cc718b7d-dec3-48bf-8b6b-e752b2a03ae7 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:53.287263 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cc718b7d-dec3-48bf-8b6b-e752b2a03ae7 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:53.287993 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cc718b7d-dec3-48bf-8b6b-e752b2a03ae7 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:53.288514 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cc718b7d-dec3-48bf-8b6b-e752b2a03ae7 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:53.453755 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-cc718b7d-dec3-48bf-8b6b-e752b2a03ae7 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:53.462203 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-cc718b7d-dec3-48bf-8b6b-e752b2a03ae7 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8" status: 200 len: 1266 microversion: 2.1 time: 0.201972 Sep 01 16:44:53.462705 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 448/923] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:53 2022] GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8 => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:54.483879 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-869c6596-5d71-4b5b-94c6-d4f36f406169 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:54.484709 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-869c6596-5d71-4b5b-94c6-d4f36f406169 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 267fca3e-c9de-44ba-a888-8443d96fc9c8] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:54.487189 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=10 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:54.488215 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:54.495572 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-869c6596-5d71-4b5b-94c6-d4f36f406169 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:54.496047 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-869c6596-5d71-4b5b-94c6-d4f36f406169 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:54.496719 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-869c6596-5d71-4b5b-94c6-d4f36f406169 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:54.497950 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-869c6596-5d71-4b5b-94c6-d4f36f406169 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:54.498767 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-869c6596-5d71-4b5b-94c6-d4f36f406169 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:54.499555 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-869c6596-5d71-4b5b-94c6-d4f36f406169 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:54.652759 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-869c6596-5d71-4b5b-94c6-d4f36f406169 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:54.669190 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-869c6596-5d71-4b5b-94c6-d4f36f406169 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8" status: 200 len: 1266 microversion: 2.1 time: 0.189160 Sep 01 16:44:54.669776 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 476/924] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:54 2022] GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8 => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:55.690386 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e08c2572-e539-4a50-8457-288849547e5d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:55.690999 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e08c2572-e539-4a50-8457-288849547e5d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 267fca3e-c9de-44ba-a888-8443d96fc9c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:55.693032 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:55.699832 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e08c2572-e539-4a50-8457-288849547e5d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:55.700377 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e08c2572-e539-4a50-8457-288849547e5d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:55.700809 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e08c2572-e539-4a50-8457-288849547e5d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:55.701511 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e08c2572-e539-4a50-8457-288849547e5d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:55.701985 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e08c2572-e539-4a50-8457-288849547e5d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:55.702473 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e08c2572-e539-4a50-8457-288849547e5d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:55.845634 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e08c2572-e539-4a50-8457-288849547e5d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:55.853859 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e08c2572-e539-4a50-8457-288849547e5d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8" status: 200 len: 1266 microversion: 2.1 time: 0.167615 Sep 01 16:44:55.854434 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 449/925] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:55 2022] GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:56.876645 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-49c38f2e-5a6a-4c2f-b68a-f58613c81440 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:56.877376 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-49c38f2e-5a6a-4c2f-b68a-f58613c81440 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 267fca3e-c9de-44ba-a888-8443d96fc9c8] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:56.886382 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-49c38f2e-5a6a-4c2f-b68a-f58613c81440 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:56.887131 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-49c38f2e-5a6a-4c2f-b68a-f58613c81440 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:56.887715 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-49c38f2e-5a6a-4c2f-b68a-f58613c81440 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:56.888454 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-49c38f2e-5a6a-4c2f-b68a-f58613c81440 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:56.888905 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-49c38f2e-5a6a-4c2f-b68a-f58613c81440 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:56.889326 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-49c38f2e-5a6a-4c2f-b68a-f58613c81440 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:57.044240 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-49c38f2e-5a6a-4c2f-b68a-f58613c81440 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:57.052847 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-49c38f2e-5a6a-4c2f-b68a-f58613c81440 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8" status: 200 len: 1266 microversion: 2.1 time: 0.181085 Sep 01 16:44:57.053841 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 477/926] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:56 2022] GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:58.079299 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-436aaf73-fa4c-400d-8821-d61c8553ce10 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:58.079972 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-436aaf73-fa4c-400d-8821-d61c8553ce10 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 267fca3e-c9de-44ba-a888-8443d96fc9c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:58.082524 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=22 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:58.083408 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=6 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:58.090170 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-436aaf73-fa4c-400d-8821-d61c8553ce10 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:58.090654 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-436aaf73-fa4c-400d-8821-d61c8553ce10 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:58.091107 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-436aaf73-fa4c-400d-8821-d61c8553ce10 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:58.091822 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-436aaf73-fa4c-400d-8821-d61c8553ce10 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:58.092305 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-436aaf73-fa4c-400d-8821-d61c8553ce10 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:58.092723 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-436aaf73-fa4c-400d-8821-d61c8553ce10 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:58.096269 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=41 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:58.242986 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-436aaf73-fa4c-400d-8821-d61c8553ce10 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:58.251300 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-436aaf73-fa4c-400d-8821-d61c8553ce10 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8" status: 200 len: 1266 microversion: 2.1 time: 0.177124 Sep 01 16:44:58.251908 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 450/927] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:58 2022] GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:44:59.274105 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e1d529ba-c08b-4f36-ba7b-49fb952285c4 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:59.274764 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e1d529ba-c08b-4f36-ba7b-49fb952285c4 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 267fca3e-c9de-44ba-a888-8443d96fc9c8] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:59.281610 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e1d529ba-c08b-4f36-ba7b-49fb952285c4 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:59.282123 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e1d529ba-c08b-4f36-ba7b-49fb952285c4 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:59.282532 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e1d529ba-c08b-4f36-ba7b-49fb952285c4 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:59.283207 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e1d529ba-c08b-4f36-ba7b-49fb952285c4 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:59.283650 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e1d529ba-c08b-4f36-ba7b-49fb952285c4 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:59.284136 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e1d529ba-c08b-4f36-ba7b-49fb952285c4 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:59.458937 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-e1d529ba-c08b-4f36-ba7b-49fb952285c4 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:59.468036 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e1d529ba-c08b-4f36-ba7b-49fb952285c4 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8" status: 200 len: 1266 microversion: 2.1 time: 0.198103 Sep 01 16:44:59.468631 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 478/928] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:59 2022] GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:45:00.497565 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c29757d3-ab56-4cfd-8dcb-76335e886074 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:00.498578 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c29757d3-ab56-4cfd-8dcb-76335e886074 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 267fca3e-c9de-44ba-a888-8443d96fc9c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:00.510162 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c29757d3-ab56-4cfd-8dcb-76335e886074 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:00.510874 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c29757d3-ab56-4cfd-8dcb-76335e886074 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:00.511515 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c29757d3-ab56-4cfd-8dcb-76335e886074 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:00.512854 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c29757d3-ab56-4cfd-8dcb-76335e886074 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:00.513578 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c29757d3-ab56-4cfd-8dcb-76335e886074 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:00.514335 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c29757d3-ab56-4cfd-8dcb-76335e886074 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:00.729602 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c29757d3-ab56-4cfd-8dcb-76335e886074 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:00.747262 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c29757d3-ab56-4cfd-8dcb-76335e886074 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8" status: 200 len: 1266 microversion: 2.1 time: 0.257125 Sep 01 16:45:00.749201 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 451/929] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:00 2022] GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8 => generated 1266 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:00.773820 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ca17dc2a-eeb6-461f-b82d-4d827d560de5 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d13b9b25-9b6d-48f0-b6ea-665f029f6102", "device": "/dev/sdb"}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:45:00.779262 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ca17dc2a-eeb6-461f-b82d-4d827d560de5 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [instance: ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:00.790617 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ca17dc2a-eeb6-461f-b82d-4d827d560de5 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:00.791486 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ca17dc2a-eeb6-461f-b82d-4d827d560de5 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:00.792292 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ca17dc2a-eeb6-461f-b82d-4d827d560de5 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:00.793541 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ca17dc2a-eeb6-461f-b82d-4d827d560de5 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:00.794357 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ca17dc2a-eeb6-461f-b82d-4d827d560de5 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:00.795114 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ca17dc2a-eeb6-461f-b82d-4d827d560de5 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:01.285412 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ca17dc2a-eeb6-461f-b82d-4d827d560de5 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] 10.222.0.62 "POST /compute/v2.1/servers/ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.539569 Sep 01 16:45:01.286172 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 479/930] 10.222.0.62 () {60 vars in 1323 bytes} [Thu Sep 1 16:45:00 2022] POST /compute/v2.1/servers/ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9/os-volume_attachments => generated 194 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:45:01.784576 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-eeda2f2d-2dd7-4001-a87d-cefad27a26aa tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:01.785663 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-eeda2f2d-2dd7-4001-a87d-cefad27a26aa tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 267fca3e-c9de-44ba-a888-8443d96fc9c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:01.796310 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eeda2f2d-2dd7-4001-a87d-cefad27a26aa tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:01.797165 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eeda2f2d-2dd7-4001-a87d-cefad27a26aa tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:01.797965 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eeda2f2d-2dd7-4001-a87d-cefad27a26aa tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:01.799243 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eeda2f2d-2dd7-4001-a87d-cefad27a26aa tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:01.800071 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eeda2f2d-2dd7-4001-a87d-cefad27a26aa tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:01.800861 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eeda2f2d-2dd7-4001-a87d-cefad27a26aa tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:01.969186 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-eeda2f2d-2dd7-4001-a87d-cefad27a26aa tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:01.981629 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-eeda2f2d-2dd7-4001-a87d-cefad27a26aa tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8" status: 200 len: 1266 microversion: 2.1 time: 0.204157 Sep 01 16:45:01.982615 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 452/931] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:01 2022] GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8 => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:02.257320 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-f815435c-53d4-464c-869b-09592098d0a3 req-546db85c-9fa3-4cbd-beb4-072bd8e6394e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "267fca3e-c9de-44ba-a888-8443d96fc9c8", "name": "network-vif-plugged", "status": "completed", "tag": "7eec2532-2b18-4d3f-93b9-c8294bd927c2"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:45:02.275956 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-f815435c-53d4-464c-869b-09592098d0a3 req-546db85c-9fa3-4cbd-beb4-072bd8e6394e service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:02.276808 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-f815435c-53d4-464c-869b-09592098d0a3 req-546db85c-9fa3-4cbd-beb4-072bd8e6394e service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:02.277555 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-f815435c-53d4-464c-869b-09592098d0a3 req-546db85c-9fa3-4cbd-beb4-072bd8e6394e service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:02.296510 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-f815435c-53d4-464c-869b-09592098d0a3 req-546db85c-9fa3-4cbd-beb4-072bd8e6394e service nova] Creating event network-vif-plugged:7eec2532-2b18-4d3f-93b9-c8294bd927c2 for instance 267fca3e-c9de-44ba-a888-8443d96fc9c8 on hv-cinder-85221 Sep 01 16:45:02.304855 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-f815435c-53d4-464c-869b-09592098d0a3 req-546db85c-9fa3-4cbd-beb4-072bd8e6394e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054111 Sep 01 16:45:02.305864 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 480/932] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:45:03.013568 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-86cc3815-43fb-4450-9dc1-12113aead7fc tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:03.014190 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-86cc3815-43fb-4450-9dc1-12113aead7fc tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 267fca3e-c9de-44ba-a888-8443d96fc9c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:03.021538 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-86cc3815-43fb-4450-9dc1-12113aead7fc tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:03.022069 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-86cc3815-43fb-4450-9dc1-12113aead7fc tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:03.022643 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-86cc3815-43fb-4450-9dc1-12113aead7fc tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:03.023463 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-86cc3815-43fb-4450-9dc1-12113aead7fc tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:03.023993 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-86cc3815-43fb-4450-9dc1-12113aead7fc tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:03.024466 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-86cc3815-43fb-4450-9dc1-12113aead7fc tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:03.211334 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-86cc3815-43fb-4450-9dc1-12113aead7fc tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:03.221497 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-86cc3815-43fb-4450-9dc1-12113aead7fc tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8" status: 200 len: 1266 microversion: 2.1 time: 0.211645 Sep 01 16:45:03.222938 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 453/933] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:03 2022] GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8 => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:04.247352 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-2e4d1aa0-bec0-4675-8d4d-209540899bce tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:04.248061 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-2e4d1aa0-bec0-4675-8d4d-209540899bce tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 267fca3e-c9de-44ba-a888-8443d96fc9c8] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:04.260217 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2e4d1aa0-bec0-4675-8d4d-209540899bce tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:04.260898 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2e4d1aa0-bec0-4675-8d4d-209540899bce tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:04.261438 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2e4d1aa0-bec0-4675-8d4d-209540899bce tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:04.262364 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2e4d1aa0-bec0-4675-8d4d-209540899bce tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:04.262979 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2e4d1aa0-bec0-4675-8d4d-209540899bce tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:04.263493 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2e4d1aa0-bec0-4675-8d4d-209540899bce tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:04.266674 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:04.425335 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-2e4d1aa0-bec0-4675-8d4d-209540899bce tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:04.433934 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-2e4d1aa0-bec0-4675-8d4d-209540899bce tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8" status: 200 len: 1453 microversion: 2.1 time: 0.194005 Sep 01 16:45:04.434746 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 481/934] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:04 2022] GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8 => generated 1453 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:04.457314 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-cdb68921-8933-4170-a6f8-cb0bdd66d563 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:04.457962 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-cdb68921-8933-4170-a6f8-cb0bdd66d563 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 267fca3e-c9de-44ba-a888-8443d96fc9c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:04.469418 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cdb68921-8933-4170-a6f8-cb0bdd66d563 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:04.470410 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cdb68921-8933-4170-a6f8-cb0bdd66d563 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:04.470859 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cdb68921-8933-4170-a6f8-cb0bdd66d563 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:04.472042 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cdb68921-8933-4170-a6f8-cb0bdd66d563 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:04.472869 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cdb68921-8933-4170-a6f8-cb0bdd66d563 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:04.473433 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cdb68921-8933-4170-a6f8-cb0bdd66d563 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:04.653386 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-cdb68921-8933-4170-a6f8-cb0bdd66d563 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:04.661480 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-cdb68921-8933-4170-a6f8-cb0bdd66d563 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8" status: 200 len: 1453 microversion: 2.1 time: 0.208178 Sep 01 16:45:04.662086 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 454/935] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:04 2022] GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8 => generated 1453 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:06.641295 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-45729c4a-1f81-4981-9bf2-c56f385724bd req-d2c6cb49-78ff-40ae-9195-1165479f0678 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "267fca3e-c9de-44ba-a888-8443d96fc9c8", "tag": "7eec2532-2b18-4d3f-93b9-c8294bd927c2"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:45:06.653424 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-45729c4a-1f81-4981-9bf2-c56f385724bd req-d2c6cb49-78ff-40ae-9195-1165479f0678 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:06.654032 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-45729c4a-1f81-4981-9bf2-c56f385724bd req-d2c6cb49-78ff-40ae-9195-1165479f0678 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:06.654702 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-45729c4a-1f81-4981-9bf2-c56f385724bd req-d2c6cb49-78ff-40ae-9195-1165479f0678 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:06.677015 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-45729c4a-1f81-4981-9bf2-c56f385724bd req-d2c6cb49-78ff-40ae-9195-1165479f0678 service nova] Creating event network-changed:7eec2532-2b18-4d3f-93b9-c8294bd927c2 for instance 267fca3e-c9de-44ba-a888-8443d96fc9c8 on hv-cinder-85221 Sep 01 16:45:06.682883 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-45729c4a-1f81-4981-9bf2-c56f385724bd req-d2c6cb49-78ff-40ae-9195-1165479f0678 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045075 Sep 01 16:45:06.683498 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 482/936] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:45:22.469967 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6cc650fb-2e8a-4e35-a7af-20813d8a527f tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:22.470550 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-6cc650fb-2e8a-4e35-a7af-20813d8a527f tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [instance: ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:22.472859 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=9 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:22.473528 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=29 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:22.480579 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6cc650fb-2e8a-4e35-a7af-20813d8a527f tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:22.481486 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6cc650fb-2e8a-4e35-a7af-20813d8a527f tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:22.481486 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6cc650fb-2e8a-4e35-a7af-20813d8a527f tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:22.482184 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6cc650fb-2e8a-4e35-a7af-20813d8a527f tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:22.482670 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6cc650fb-2e8a-4e35-a7af-20813d8a527f tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:22.483153 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6cc650fb-2e8a-4e35-a7af-20813d8a527f tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:22.622691 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-6cc650fb-2e8a-4e35-a7af-20813d8a527f tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lazy-loading 'services' on Instance uuid ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9 {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:45:22.726875 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-6cc650fb-2e8a-4e35-a7af-20813d8a527f tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9/os-volume_attachments/d13b9b25-9b6d-48f0-b6ea-665f029f6102" status: 202 len: 0 microversion: 2.1 time: 0.260729 Sep 01 16:45:22.727527 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 455/937] 10.222.0.62 () {58 vars in 1416 bytes} [Thu Sep 1 16:45:22 2022] DELETE /compute/v2.1/servers/ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9/os-volume_attachments/d13b9b25-9b6d-48f0-b6ea-665f029f6102 => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:45:23.890157 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-bdfd5025-4b7d-4e4b-91b6-03f1900a455e tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:23.891169 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-bdfd5025-4b7d-4e4b-91b6-03f1900a455e tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [instance: ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:23.895502 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=13 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:23.896662 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=7 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:23.907876 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bdfd5025-4b7d-4e4b-91b6-03f1900a455e tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:23.908741 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bdfd5025-4b7d-4e4b-91b6-03f1900a455e tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:23.909469 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bdfd5025-4b7d-4e4b-91b6-03f1900a455e tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:23.910659 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bdfd5025-4b7d-4e4b-91b6-03f1900a455e tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:23.911435 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bdfd5025-4b7d-4e4b-91b6-03f1900a455e tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:23.912233 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bdfd5025-4b7d-4e4b-91b6-03f1900a455e tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:23.945341 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-bdfd5025-4b7d-4e4b-91b6-03f1900a455e tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [instance: ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9] Going to try to terminate instance {{(pid=127199) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:45:24.037579 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-bdfd5025-4b7d-4e4b-91b6-03f1900a455e tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9" status: 204 len: 0 microversion: 2.1 time: 0.154858 Sep 01 16:45:24.039044 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 483/938] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Sep 1 16:45:23 2022] DELETE /compute/v2.1/servers/ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:45:24.049580 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-32d386c8-351e-4813-b525-a7b47237f7ed tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:24.050672 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-32d386c8-351e-4813-b525-a7b47237f7ed tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [instance: ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:24.057487 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-32d386c8-351e-4813-b525-a7b47237f7ed tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:24.057991 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-32d386c8-351e-4813-b525-a7b47237f7ed tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:24.058442 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-32d386c8-351e-4813-b525-a7b47237f7ed tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:24.059132 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-32d386c8-351e-4813-b525-a7b47237f7ed tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:24.059546 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-32d386c8-351e-4813-b525-a7b47237f7ed tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:24.060003 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-32d386c8-351e-4813-b525-a7b47237f7ed tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:24.211387 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-32d386c8-351e-4813-b525-a7b47237f7ed tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd734af142f64b2db23fc59dfde2fb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffc6ebebba5490f84b35ffb827b08d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:24.219775 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-32d386c8-351e-4813-b525-a7b47237f7ed tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] 10.222.0.62 "GET /compute/v2.1/servers/ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9" status: 200 len: 1512 microversion: 2.1 time: 0.175068 Sep 01 16:45:24.220634 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 456/939] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:24 2022] GET /compute/v2.1/servers/ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9 => generated 1512 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:25.244410 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d353ad41-d840-4618-8120-d76837a73b0b tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:25.245189 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d353ad41-d840-4618-8120-d76837a73b0b tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [instance: ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:25.252054 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d353ad41-d840-4618-8120-d76837a73b0b tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:25.252633 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d353ad41-d840-4618-8120-d76837a73b0b tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:25.253065 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d353ad41-d840-4618-8120-d76837a73b0b tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:25.253763 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d353ad41-d840-4618-8120-d76837a73b0b tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:25.254209 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d353ad41-d840-4618-8120-d76837a73b0b tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:25.254622 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d353ad41-d840-4618-8120-d76837a73b0b tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:25.417137 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d353ad41-d840-4618-8120-d76837a73b0b tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd734af142f64b2db23fc59dfde2fb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffc6ebebba5490f84b35ffb827b08d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:25.425155 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d353ad41-d840-4618-8120-d76837a73b0b tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] 10.222.0.62 "GET /compute/v2.1/servers/ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9" status: 200 len: 1512 microversion: 2.1 time: 0.186284 Sep 01 16:45:25.425733 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 484/940] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:25 2022] GET /compute/v2.1/servers/ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9 => generated 1512 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:26.172964 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-c6c16fda-4662-4aa3-b94a-3a33a38d86b6 req-b31aaf5c-84ab-42a1-8c4e-e651ff64791b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9", "name": "network-vif-deleted", "tag": "3906c04a-0949-4ced-9606-334bfcf57b78"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:45:26.185289 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-c6c16fda-4662-4aa3-b94a-3a33a38d86b6 req-b31aaf5c-84ab-42a1-8c4e-e651ff64791b service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:26.186392 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-c6c16fda-4662-4aa3-b94a-3a33a38d86b6 req-b31aaf5c-84ab-42a1-8c4e-e651ff64791b service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:26.187101 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-c6c16fda-4662-4aa3-b94a-3a33a38d86b6 req-b31aaf5c-84ab-42a1-8c4e-e651ff64791b service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:26.201027 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-c6c16fda-4662-4aa3-b94a-3a33a38d86b6 req-b31aaf5c-84ab-42a1-8c4e-e651ff64791b service nova] Creating event network-vif-deleted:3906c04a-0949-4ced-9606-334bfcf57b78 for instance ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9 on hv-cinder-85221 Sep 01 16:45:26.207061 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-c6c16fda-4662-4aa3-b94a-3a33a38d86b6 req-b31aaf5c-84ab-42a1-8c4e-e651ff64791b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037899 Sep 01 16:45:26.207679 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 457/941] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:45:26.453599 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a7e0c827-c205-47d3-a8a2-f08e097b2dd7 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:26.454338 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-a7e0c827-c205-47d3-a8a2-f08e097b2dd7 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [instance: ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:26.461193 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a7e0c827-c205-47d3-a8a2-f08e097b2dd7 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:26.461685 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a7e0c827-c205-47d3-a8a2-f08e097b2dd7 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:26.462122 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a7e0c827-c205-47d3-a8a2-f08e097b2dd7 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:26.462828 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a7e0c827-c205-47d3-a8a2-f08e097b2dd7 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:26.463278 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a7e0c827-c205-47d3-a8a2-f08e097b2dd7 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:26.463694 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a7e0c827-c205-47d3-a8a2-f08e097b2dd7 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:26.506950 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a7e0c827-c205-47d3-a8a2-f08e097b2dd7 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:26.507429 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a7e0c827-c205-47d3-a8a2-f08e097b2dd7 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:26.507860 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a7e0c827-c205-47d3-a8a2-f08e097b2dd7 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:26.508360 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.objects.instance [None req-a7e0c827-c205-47d3-a8a2-f08e097b2dd7 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lazy-loading 'fault' on Instance uuid ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9 {{(pid=127199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:45:26.561319 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-a7e0c827-c205-47d3-a8a2-f08e097b2dd7 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd734af142f64b2db23fc59dfde2fb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffc6ebebba5490f84b35ffb827b08d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:26.576057 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-a7e0c827-c205-47d3-a8a2-f08e097b2dd7 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] 10.222.0.62 "GET /compute/v2.1/servers/ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9" status: 200 len: 1307 microversion: 2.1 time: 0.125868 Sep 01 16:45:26.577053 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 485/942] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:26 2022] GET /compute/v2.1/servers/ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9 => generated 1307 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:27.609006 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2f7f2939-3a96-4b7a-9de9-de20fcb97ef7 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:27.609840 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-2f7f2939-3a96-4b7a-9de9-de20fcb97ef7 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [instance: ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:27.616991 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2f7f2939-3a96-4b7a-9de9-de20fcb97ef7 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:27.617480 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2f7f2939-3a96-4b7a-9de9-de20fcb97ef7 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:27.617914 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2f7f2939-3a96-4b7a-9de9-de20fcb97ef7 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:27.618613 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2f7f2939-3a96-4b7a-9de9-de20fcb97ef7 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:27.619061 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2f7f2939-3a96-4b7a-9de9-de20fcb97ef7 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:27.619859 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-2f7f2939-3a96-4b7a-9de9-de20fcb97ef7 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:27.644759 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-2f7f2939-3a96-4b7a-9de9-de20fcb97ef7 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] HTTP exception thrown: Instance ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9 could not be found. Sep 01 16:45:27.647603 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2f7f2939-3a96-4b7a-9de9-de20fcb97ef7 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Request method failure captured: Sep 01 16:45:27.647603 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9 HTTP/1.1 Sep 01 16:45:27.647603 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 01 16:45:27.647603 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 01 16:45:27.647603 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Connection: close Sep 01 16:45:27.647603 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 01 16:45:27.647603 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 01 16:45:27.647603 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Host: 10.222.0.62 Sep 01 16:45:27.647603 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 01 16:45:27.647603 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 01 16:45:27.647603 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjEOFqOTewzaSnzZT__n-2ait2TuWubfzVW__uXptoFPxg7dnuutVKux8ASLJetu-sqeGuwN0uWaO-DKixbCOGr05LqWpRDZRH9lizYYjJr_ePR40Vh2DQj9HGuCMLvEeoagnyB-4QiWnP4Vteu5Eu-nfxMAUStaRfD0nQpbsstM78dE4 Sep 01 16:45:27.647603 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 01 16:45:27.647603 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 01 16:45:27.647603 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 01 16:45:27.647603 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 01 16:45:27.647603 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 01 16:45:27.647603 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 01 16:45:27.647603 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Id: 4ffc6ebebba5490f84b35ffb827b08d8 Sep 01 16:45:27.647603 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-VolumesSnapshotTestJSON-71662643 Sep 01 16:45:27.647603 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 01 16:45:27.647603 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 01 16:45:27.650048 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4ffc6ebebba5490f84b35ffb827b08d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4ffc6ebebba5490f84b35ffb827b08d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4ffc6ebebba5490f84b35ffb827b08d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4ffc6ebebba5490f84b35ffb827b08d8"}]}] Sep 01 16:45:27.650048 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-VolumesSnapshotTestJSON-71662643 Sep 01 16:45:27.650048 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Id: 4ffc6ebebba5490f84b35ffb827b08d8 Sep 01 16:45:27.650048 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-71662643 Sep 01 16:45:27.650048 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User: tempest-VolumesSnapshotTestJSON-71662643-project Sep 01 16:45:27.650048 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 01 16:45:27.650048 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 01 16:45:27.650048 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Id: fd734af142f64b2db23fc59dfde2fb0e Sep 01 16:45:27.650048 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-VolumesSnapshotTestJSON-71662643-project Sep 01 16:45:27.650048 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: method: > Sep 01 16:45:27.650048 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: exception: Instance ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9 could not be found. Sep 01 16:45:27.650048 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: action_args: {'id': 'ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9'} Sep 01 16:45:27.650884 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:45:27.650884 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:27.650884 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:45:27.650884 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:45:27.650884 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:45:27.650884 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:45:27.650884 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:45:27.650884 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:45:27.650884 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:45:27.650884 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:45:27.650884 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9 could not be found. Sep 01 16:45:27.650884 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:45:27.650884 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:27.650884 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:45:27.650884 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:27.650884 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:27.650884 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:27.650884 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:45:27.650884 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:45:27.650884 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:45:27.652608 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:45:27.652608 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:45:27.652608 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:45:27.652608 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:45:27.652608 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:45:27.652608 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:45:27.652608 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:45:27.652608 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9 could not be found. Sep 01 16:45:27.652608 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:45:27.652608 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:27.652608 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:45:27.652608 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:27.652608 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:27.652608 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:27.652608 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:45:27.652608 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:45:27.652608 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9 could not be found. Sep 01 16:45:27.652608 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:45:27.653997 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-2f7f2939-3a96-4b7a-9de9-de20fcb97ef7 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Returning 404 to user: Instance ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:45:27.653997 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-2f7f2939-3a96-4b7a-9de9-de20fcb97ef7 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] 10.222.0.62 "GET /compute/v2.1/servers/ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9" status: 404 len: 111 microversion: 2.1 time: 0.045780 Sep 01 16:45:27.653997 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 458/943] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:27 2022] GET /compute/v2.1/servers/ee3deea7-1c83-4be1-b22b-0a1ff18d3ac9 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:45:35.701636 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-52c84baf-596b-40e2-81c9-3a3d7cb6ed98 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-730013633", "imageRef": "49e5276c-002c-454f-8be8-76deb18b6b28", "flavorRef": "452", "networks": [{"uuid": "5740f89c-1069-4c6a-aa8a-30161b41663c"}]}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:45:35.770988 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.network.neutron [None req-52c84baf-596b-40e2-81c9-3a3d7cb6ed98 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] validate_networks() for [('5740f89c-1069-4c6a-aa8a-30161b41663c', None, None, None, None, None)] {{(pid=127199) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:45:36.567095 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:36.603103 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-52c84baf-596b-40e2-81c9-3a3d7cb6ed98 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Flavor limits 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:45:36.603583 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-52c84baf-596b-40e2-81c9-3a3d7cb6ed98 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Image limits 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:45:36.604262 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-52c84baf-596b-40e2-81c9-3a3d7cb6ed98 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Flavor pref 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:45:36.605134 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-52c84baf-596b-40e2-81c9-3a3d7cb6ed98 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Image pref 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:45:36.605345 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-52c84baf-596b-40e2-81c9-3a3d7cb6ed98 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:45:36.616565 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-52c84baf-596b-40e2-81c9-3a3d7cb6ed98 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:36.617116 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-52c84baf-596b-40e2-81c9-3a3d7cb6ed98 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:36.617553 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-52c84baf-596b-40e2-81c9-3a3d7cb6ed98 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:36.618276 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-52c84baf-596b-40e2-81c9-3a3d7cb6ed98 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:36.618972 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-52c84baf-596b-40e2-81c9-3a3d7cb6ed98 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:36.619411 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-52c84baf-596b-40e2-81c9-3a3d7cb6ed98 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:36.639013 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-52c84baf-596b-40e2-81c9-3a3d7cb6ed98 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Getting quotas for project 4ffc6ebebba5490f84b35ffb827b08d8. Resources: {'ram', 'cores', 'instances'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:45:36.643353 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-52c84baf-596b-40e2-81c9-3a3d7cb6ed98 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Getting quotas for user fd734af142f64b2db23fc59dfde2fb0e and project 4ffc6ebebba5490f84b35ffb827b08d8. Resources: {'ram', 'cores', 'instances'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:45:36.657109 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-52c84baf-596b-40e2-81c9-3a3d7cb6ed98 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Going to run 1 instances... {{(pid=127199) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:45:36.659465 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-52c84baf-596b-40e2-81c9-3a3d7cb6ed98 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [instance: d90119a4-33d9-4e07-86fa-f0416da21dd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='49e5276c-002c-454f-8be8-76deb18b6b28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:45:36.711328 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR oslo.messaging._drivers.impl_rabbit [None req-52c84baf-596b-40e2-81c9-3a3d7cb6ed98 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [b06a207f-e401-4177-b160-cce1fb54edef] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 16:45:37.720884 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO oslo.messaging._drivers.impl_rabbit [None req-52c84baf-596b-40e2-81c9-3a3d7cb6ed98 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [b06a207f-e401-4177-b160-cce1fb54edef] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 37996. Sep 01 16:45:37.725656 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-52c84baf-596b-40e2-81c9-3a3d7cb6ed98 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.027841 Sep 01 16:45:37.726529 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 486/944] 10.222.0.62 () {60 vars in 1147 bytes} [Thu Sep 1 16:45:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2030 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:45:37.738801 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-02dc8e79-e348-42b2-98ad-8c34d34922f6 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:37.739595 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-02dc8e79-e348-42b2-98ad-8c34d34922f6 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [instance: d90119a4-33d9-4e07-86fa-f0416da21dd4] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:37.742878 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=8 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:37.743693 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:37.829110 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-02dc8e79-e348-42b2-98ad-8c34d34922f6 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd734af142f64b2db23fc59dfde2fb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffc6ebebba5490f84b35ffb827b08d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:37.838004 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-02dc8e79-e348-42b2-98ad-8c34d34922f6 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] 10.222.0.62 "GET /compute/v2.1/servers/d90119a4-33d9-4e07-86fa-f0416da21dd4" status: 200 len: 1218 microversion: 2.1 time: 0.103106 Sep 01 16:45:37.839309 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 459/945] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:37 2022] GET /compute/v2.1/servers/d90119a4-33d9-4e07-86fa-f0416da21dd4 => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:38.869705 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-4639a6dd-7afd-47d2-af60-afcd46e86e75 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:38.870921 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-4639a6dd-7afd-47d2-af60-afcd46e86e75 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [instance: d90119a4-33d9-4e07-86fa-f0416da21dd4] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:38.884543 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4639a6dd-7afd-47d2-af60-afcd46e86e75 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:38.885343 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4639a6dd-7afd-47d2-af60-afcd46e86e75 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:38.886097 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4639a6dd-7afd-47d2-af60-afcd46e86e75 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:38.887312 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4639a6dd-7afd-47d2-af60-afcd46e86e75 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:38.888619 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4639a6dd-7afd-47d2-af60-afcd46e86e75 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:38.889391 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4639a6dd-7afd-47d2-af60-afcd46e86e75 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:39.021324 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-4639a6dd-7afd-47d2-af60-afcd46e86e75 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd734af142f64b2db23fc59dfde2fb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffc6ebebba5490f84b35ffb827b08d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:39.036687 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-4639a6dd-7afd-47d2-af60-afcd46e86e75 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] 10.222.0.62 "GET /compute/v2.1/servers/d90119a4-33d9-4e07-86fa-f0416da21dd4" status: 200 len: 1278 microversion: 2.1 time: 0.176038 Sep 01 16:45:39.039080 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 487/946] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:38 2022] GET /compute/v2.1/servers/d90119a4-33d9-4e07-86fa-f0416da21dd4 => generated 1278 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:45:40.075292 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ea4cf133-8a5e-4516-a1b3-d98aa92affdc tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:40.076162 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-ea4cf133-8a5e-4516-a1b3-d98aa92affdc tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [instance: d90119a4-33d9-4e07-86fa-f0416da21dd4] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:40.083592 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ea4cf133-8a5e-4516-a1b3-d98aa92affdc tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:40.084426 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ea4cf133-8a5e-4516-a1b3-d98aa92affdc tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:40.085212 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ea4cf133-8a5e-4516-a1b3-d98aa92affdc tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:40.085590 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ea4cf133-8a5e-4516-a1b3-d98aa92affdc tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:40.086056 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ea4cf133-8a5e-4516-a1b3-d98aa92affdc tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:40.087057 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-ea4cf133-8a5e-4516-a1b3-d98aa92affdc tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:40.391556 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-ea4cf133-8a5e-4516-a1b3-d98aa92affdc tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd734af142f64b2db23fc59dfde2fb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffc6ebebba5490f84b35ffb827b08d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:40.400093 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ea4cf133-8a5e-4516-a1b3-d98aa92affdc tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] 10.222.0.62 "GET /compute/v2.1/servers/d90119a4-33d9-4e07-86fa-f0416da21dd4" status: 200 len: 1318 microversion: 2.1 time: 0.328839 Sep 01 16:45:40.400692 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 460/947] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:40 2022] GET /compute/v2.1/servers/d90119a4-33d9-4e07-86fa-f0416da21dd4 => generated 1318 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:40.554397 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-03ad939f-d6fa-41b8-9921-9b9a6297f534 req-0fcea5be-119b-4092-82c5-b7e5817983e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d90119a4-33d9-4e07-86fa-f0416da21dd4", "tag": "98dcd68b-8d89-4abb-b08d-fc12fa538eef"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:45:40.569044 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-03ad939f-d6fa-41b8-9921-9b9a6297f534 req-0fcea5be-119b-4092-82c5-b7e5817983e9 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:40.569870 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-03ad939f-d6fa-41b8-9921-9b9a6297f534 req-0fcea5be-119b-4092-82c5-b7e5817983e9 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:40.570354 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-03ad939f-d6fa-41b8-9921-9b9a6297f534 req-0fcea5be-119b-4092-82c5-b7e5817983e9 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:40.594295 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-03ad939f-d6fa-41b8-9921-9b9a6297f534 req-0fcea5be-119b-4092-82c5-b7e5817983e9 service nova] Creating event network-changed:98dcd68b-8d89-4abb-b08d-fc12fa538eef for instance d90119a4-33d9-4e07-86fa-f0416da21dd4 on hv-cinder-85221 Sep 01 16:45:40.599847 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-03ad939f-d6fa-41b8-9921-9b9a6297f534 req-0fcea5be-119b-4092-82c5-b7e5817983e9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049983 Sep 01 16:45:40.600485 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 488/948] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:45:41.426798 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7d2080e9-d12f-43f7-9d82-a0754900e4b8 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:41.427831 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7d2080e9-d12f-43f7-9d82-a0754900e4b8 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [instance: d90119a4-33d9-4e07-86fa-f0416da21dd4] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:41.439557 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7d2080e9-d12f-43f7-9d82-a0754900e4b8 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:41.440096 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7d2080e9-d12f-43f7-9d82-a0754900e4b8 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:41.440708 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7d2080e9-d12f-43f7-9d82-a0754900e4b8 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:41.441832 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7d2080e9-d12f-43f7-9d82-a0754900e4b8 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:41.442650 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7d2080e9-d12f-43f7-9d82-a0754900e4b8 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:41.443685 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7d2080e9-d12f-43f7-9d82-a0754900e4b8 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:41.618574 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7d2080e9-d12f-43f7-9d82-a0754900e4b8 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd734af142f64b2db23fc59dfde2fb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffc6ebebba5490f84b35ffb827b08d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:41.629748 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7d2080e9-d12f-43f7-9d82-a0754900e4b8 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] 10.222.0.62 "GET /compute/v2.1/servers/d90119a4-33d9-4e07-86fa-f0416da21dd4" status: 200 len: 1318 microversion: 2.1 time: 0.208981 Sep 01 16:45:41.630641 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 461/949] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:41 2022] GET /compute/v2.1/servers/d90119a4-33d9-4e07-86fa-f0416da21dd4 => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:42.659688 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-83526018-5f17-4ae3-a684-039e196f6e0d tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:42.661241 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-83526018-5f17-4ae3-a684-039e196f6e0d tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [instance: d90119a4-33d9-4e07-86fa-f0416da21dd4] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:42.668575 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-83526018-5f17-4ae3-a684-039e196f6e0d tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:42.669066 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-83526018-5f17-4ae3-a684-039e196f6e0d tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:42.669508 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-83526018-5f17-4ae3-a684-039e196f6e0d tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:42.670213 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-83526018-5f17-4ae3-a684-039e196f6e0d tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:42.670666 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-83526018-5f17-4ae3-a684-039e196f6e0d tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:42.671088 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-83526018-5f17-4ae3-a684-039e196f6e0d tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:42.834613 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-83526018-5f17-4ae3-a684-039e196f6e0d tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd734af142f64b2db23fc59dfde2fb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffc6ebebba5490f84b35ffb827b08d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:42.842713 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-83526018-5f17-4ae3-a684-039e196f6e0d tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] 10.222.0.62 "GET /compute/v2.1/servers/d90119a4-33d9-4e07-86fa-f0416da21dd4" status: 200 len: 1318 microversion: 2.1 time: 0.187761 Sep 01 16:45:42.843280 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 489/950] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:42 2022] GET /compute/v2.1/servers/d90119a4-33d9-4e07-86fa-f0416da21dd4 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:43.872405 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c9ad4ec6-6af1-4959-bd6e-c68ba0abc8d2 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:43.873011 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c9ad4ec6-6af1-4959-bd6e-c68ba0abc8d2 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [instance: d90119a4-33d9-4e07-86fa-f0416da21dd4] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:43.879346 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c9ad4ec6-6af1-4959-bd6e-c68ba0abc8d2 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:43.879829 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c9ad4ec6-6af1-4959-bd6e-c68ba0abc8d2 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:43.880329 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c9ad4ec6-6af1-4959-bd6e-c68ba0abc8d2 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:43.881170 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c9ad4ec6-6af1-4959-bd6e-c68ba0abc8d2 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:43.881633 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c9ad4ec6-6af1-4959-bd6e-c68ba0abc8d2 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:43.882048 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c9ad4ec6-6af1-4959-bd6e-c68ba0abc8d2 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:44.049359 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c9ad4ec6-6af1-4959-bd6e-c68ba0abc8d2 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd734af142f64b2db23fc59dfde2fb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffc6ebebba5490f84b35ffb827b08d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:44.058296 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c9ad4ec6-6af1-4959-bd6e-c68ba0abc8d2 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] 10.222.0.62 "GET /compute/v2.1/servers/d90119a4-33d9-4e07-86fa-f0416da21dd4" status: 200 len: 1318 microversion: 2.1 time: 0.189744 Sep 01 16:45:44.058866 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 462/951] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:43 2022] GET /compute/v2.1/servers/d90119a4-33d9-4e07-86fa-f0416da21dd4 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:45.089302 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-f839b32c-ac64-4569-b2bd-20f643eb92c2 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:45.089905 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-f839b32c-ac64-4569-b2bd-20f643eb92c2 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [instance: d90119a4-33d9-4e07-86fa-f0416da21dd4] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:45.096960 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f839b32c-ac64-4569-b2bd-20f643eb92c2 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:45.097453 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f839b32c-ac64-4569-b2bd-20f643eb92c2 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:45.097883 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f839b32c-ac64-4569-b2bd-20f643eb92c2 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:45.098585 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f839b32c-ac64-4569-b2bd-20f643eb92c2 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:45.099028 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f839b32c-ac64-4569-b2bd-20f643eb92c2 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:45.099511 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f839b32c-ac64-4569-b2bd-20f643eb92c2 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:45.266284 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-f839b32c-ac64-4569-b2bd-20f643eb92c2 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd734af142f64b2db23fc59dfde2fb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffc6ebebba5490f84b35ffb827b08d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:45.277374 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-f839b32c-ac64-4569-b2bd-20f643eb92c2 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] 10.222.0.62 "GET /compute/v2.1/servers/d90119a4-33d9-4e07-86fa-f0416da21dd4" status: 200 len: 1318 microversion: 2.1 time: 0.191837 Sep 01 16:45:45.278034 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 490/952] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:45 2022] GET /compute/v2.1/servers/d90119a4-33d9-4e07-86fa-f0416da21dd4 => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:46.299371 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3f514cb4-6e07-4ecb-888a-68fe3d87ddeb tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:46.300104 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-3f514cb4-6e07-4ecb-888a-68fe3d87ddeb tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [instance: d90119a4-33d9-4e07-86fa-f0416da21dd4] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:46.306792 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3f514cb4-6e07-4ecb-888a-68fe3d87ddeb tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:46.307286 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3f514cb4-6e07-4ecb-888a-68fe3d87ddeb tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:46.307734 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3f514cb4-6e07-4ecb-888a-68fe3d87ddeb tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:46.308483 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3f514cb4-6e07-4ecb-888a-68fe3d87ddeb tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:46.308948 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3f514cb4-6e07-4ecb-888a-68fe3d87ddeb tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:46.309387 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3f514cb4-6e07-4ecb-888a-68fe3d87ddeb tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:46.468842 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-3f514cb4-6e07-4ecb-888a-68fe3d87ddeb tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd734af142f64b2db23fc59dfde2fb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffc6ebebba5490f84b35ffb827b08d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:46.481290 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3f514cb4-6e07-4ecb-888a-68fe3d87ddeb tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] 10.222.0.62 "GET /compute/v2.1/servers/d90119a4-33d9-4e07-86fa-f0416da21dd4" status: 200 len: 1318 microversion: 2.1 time: 0.185719 Sep 01 16:45:46.482268 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 463/953] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:46 2022] GET /compute/v2.1/servers/d90119a4-33d9-4e07-86fa-f0416da21dd4 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:46.870977 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-4b1741e3-9992-48ed-9e04-3af79b1d3f30 req-38383859-b5d5-4a96-8d85-775de6919488 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d90119a4-33d9-4e07-86fa-f0416da21dd4", "name": "network-vif-plugged", "status": "completed", "tag": "98dcd68b-8d89-4abb-b08d-fc12fa538eef"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:45:46.879317 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=2 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:46.880608 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=6 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:46.891438 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-4b1741e3-9992-48ed-9e04-3af79b1d3f30 req-38383859-b5d5-4a96-8d85-775de6919488 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:46.892286 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-4b1741e3-9992-48ed-9e04-3af79b1d3f30 req-38383859-b5d5-4a96-8d85-775de6919488 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:46.893012 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-4b1741e3-9992-48ed-9e04-3af79b1d3f30 req-38383859-b5d5-4a96-8d85-775de6919488 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:46.914108 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-4b1741e3-9992-48ed-9e04-3af79b1d3f30 req-38383859-b5d5-4a96-8d85-775de6919488 service nova] Creating event network-vif-plugged:98dcd68b-8d89-4abb-b08d-fc12fa538eef for instance d90119a4-33d9-4e07-86fa-f0416da21dd4 on hv-cinder-85221 Sep 01 16:45:46.921561 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-4b1741e3-9992-48ed-9e04-3af79b1d3f30 req-38383859-b5d5-4a96-8d85-775de6919488 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056795 Sep 01 16:45:46.922317 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 491/954] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:45:47.513448 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7163b0d6-ff34-492a-859a-c8fd548f01fc tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:47.514050 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7163b0d6-ff34-492a-859a-c8fd548f01fc tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [instance: d90119a4-33d9-4e07-86fa-f0416da21dd4] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:47.520906 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7163b0d6-ff34-492a-859a-c8fd548f01fc tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:47.521575 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7163b0d6-ff34-492a-859a-c8fd548f01fc tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:47.522103 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7163b0d6-ff34-492a-859a-c8fd548f01fc tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:47.522807 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7163b0d6-ff34-492a-859a-c8fd548f01fc tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:47.523263 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7163b0d6-ff34-492a-859a-c8fd548f01fc tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:47.523811 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7163b0d6-ff34-492a-859a-c8fd548f01fc tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:47.689448 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7163b0d6-ff34-492a-859a-c8fd548f01fc tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd734af142f64b2db23fc59dfde2fb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffc6ebebba5490f84b35ffb827b08d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:47.698406 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7163b0d6-ff34-492a-859a-c8fd548f01fc tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] 10.222.0.62 "GET /compute/v2.1/servers/d90119a4-33d9-4e07-86fa-f0416da21dd4" status: 200 len: 1318 microversion: 2.1 time: 0.189128 Sep 01 16:45:47.698989 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 464/955] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:47 2022] GET /compute/v2.1/servers/d90119a4-33d9-4e07-86fa-f0416da21dd4 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:48.721608 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a41bd94e-f8b2-4559-b3d8-2790d5bbd55c tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:48.722295 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-a41bd94e-f8b2-4559-b3d8-2790d5bbd55c tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [instance: d90119a4-33d9-4e07-86fa-f0416da21dd4] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:48.729394 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a41bd94e-f8b2-4559-b3d8-2790d5bbd55c tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:48.729394 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a41bd94e-f8b2-4559-b3d8-2790d5bbd55c tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:48.730827 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a41bd94e-f8b2-4559-b3d8-2790d5bbd55c tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:48.730827 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a41bd94e-f8b2-4559-b3d8-2790d5bbd55c tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:48.730827 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a41bd94e-f8b2-4559-b3d8-2790d5bbd55c tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:48.734829 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a41bd94e-f8b2-4559-b3d8-2790d5bbd55c tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:48.875628 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-a41bd94e-f8b2-4559-b3d8-2790d5bbd55c tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd734af142f64b2db23fc59dfde2fb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffc6ebebba5490f84b35ffb827b08d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:48.884473 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-a41bd94e-f8b2-4559-b3d8-2790d5bbd55c tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] 10.222.0.62 "GET /compute/v2.1/servers/d90119a4-33d9-4e07-86fa-f0416da21dd4" status: 200 len: 1507 microversion: 2.1 time: 0.167603 Sep 01 16:45:48.885074 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 492/956] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:48 2022] GET /compute/v2.1/servers/d90119a4-33d9-4e07-86fa-f0416da21dd4 => generated 1507 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:48.914521 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8e918924-870f-4fff-928c-c598791867be tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "971070a3-202e-4bab-825f-d2d9984e102d", "device": "/dev/sdb"}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:45:48.917565 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8e918924-870f-4fff-928c-c598791867be tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [instance: d90119a4-33d9-4e07-86fa-f0416da21dd4] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:48.919636 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:48.926753 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8e918924-870f-4fff-928c-c598791867be tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:48.927480 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8e918924-870f-4fff-928c-c598791867be tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:48.928124 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8e918924-870f-4fff-928c-c598791867be tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:48.928907 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8e918924-870f-4fff-928c-c598791867be tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:48.929399 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8e918924-870f-4fff-928c-c598791867be tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:48.929862 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8e918924-870f-4fff-928c-c598791867be tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:49.198792 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8e918924-870f-4fff-928c-c598791867be tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] 10.222.0.62 "POST /compute/v2.1/servers/d90119a4-33d9-4e07-86fa-f0416da21dd4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288600 Sep 01 16:45:49.199420 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 465/957] 10.222.0.62 () {60 vars in 1323 bytes} [Thu Sep 1 16:45:48 2022] POST /compute/v2.1/servers/d90119a4-33d9-4e07-86fa-f0416da21dd4/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:46:06.607214 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d49fad11-b3af-4908-a189-30b578b453a9 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:06.607862 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d49fad11-b3af-4908-a189-30b578b453a9 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [instance: d90119a4-33d9-4e07-86fa-f0416da21dd4] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:06.612698 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:46:06.613819 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=30 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:46:06.622061 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d49fad11-b3af-4908-a189-30b578b453a9 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:06.622542 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d49fad11-b3af-4908-a189-30b578b453a9 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:06.624022 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d49fad11-b3af-4908-a189-30b578b453a9 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:06.624734 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d49fad11-b3af-4908-a189-30b578b453a9 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:06.625201 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d49fad11-b3af-4908-a189-30b578b453a9 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:06.625611 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d49fad11-b3af-4908-a189-30b578b453a9 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:06.715313 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.objects.instance [None req-d49fad11-b3af-4908-a189-30b578b453a9 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lazy-loading 'services' on Instance uuid d90119a4-33d9-4e07-86fa-f0416da21dd4 {{(pid=127199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:46:06.793911 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d49fad11-b3af-4908-a189-30b578b453a9 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] 10.222.0.62 "DELETE /compute/v2.1/servers/d90119a4-33d9-4e07-86fa-f0416da21dd4/os-volume_attachments/971070a3-202e-4bab-825f-d2d9984e102d" status: 202 len: 0 microversion: 2.1 time: 0.190642 Sep 01 16:46:06.794497 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 493/958] 10.222.0.62 () {58 vars in 1416 bytes} [Thu Sep 1 16:46:06 2022] DELETE /compute/v2.1/servers/d90119a4-33d9-4e07-86fa-f0416da21dd4/os-volume_attachments/971070a3-202e-4bab-825f-d2d9984e102d => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:46:07.938192 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-3f9d8a4c-9f89-4fea-9e55-19054986af15 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:07.938890 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-3f9d8a4c-9f89-4fea-9e55-19054986af15 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [instance: d90119a4-33d9-4e07-86fa-f0416da21dd4] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:07.941934 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=16 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:46:07.943261 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:46:07.950472 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3f9d8a4c-9f89-4fea-9e55-19054986af15 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:07.950994 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3f9d8a4c-9f89-4fea-9e55-19054986af15 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:07.951406 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3f9d8a4c-9f89-4fea-9e55-19054986af15 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:07.952245 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3f9d8a4c-9f89-4fea-9e55-19054986af15 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:07.952705 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3f9d8a4c-9f89-4fea-9e55-19054986af15 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:07.953125 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-3f9d8a4c-9f89-4fea-9e55-19054986af15 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:07.984653 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-3f9d8a4c-9f89-4fea-9e55-19054986af15 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [instance: d90119a4-33d9-4e07-86fa-f0416da21dd4] Going to try to terminate instance {{(pid=127198) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:46:08.069335 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 16:46:08.069624 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Thu Sep 1 16:46:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d90119a4-33d9-4e07-86fa-f0416da21dd4 (ip 10.222.0.62) !!! Sep 01 16:46:08.097890 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-3f9d8a4c-9f89-4fea-9e55-19054986af15 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] 10.222.0.62 "DELETE /compute/v2.1/servers/d90119a4-33d9-4e07-86fa-f0416da21dd4" status: 204 len: 0 microversion: 2.1 time: 0.163481 Sep 01 16:46:08.097890 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 466/959] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Sep 1 16:46:07 2022] DELETE /compute/v2.1/servers/d90119a4-33d9-4e07-86fa-f0416da21dd4 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 16:46:08.112618 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-4a450381-6f5c-46ba-bfd1-95bf8b614140 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:08.113735 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-4a450381-6f5c-46ba-bfd1-95bf8b614140 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [instance: d90119a4-33d9-4e07-86fa-f0416da21dd4] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:08.123781 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4a450381-6f5c-46ba-bfd1-95bf8b614140 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:08.124579 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4a450381-6f5c-46ba-bfd1-95bf8b614140 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:08.125244 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4a450381-6f5c-46ba-bfd1-95bf8b614140 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:08.126360 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4a450381-6f5c-46ba-bfd1-95bf8b614140 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:08.127088 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4a450381-6f5c-46ba-bfd1-95bf8b614140 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:08.127766 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4a450381-6f5c-46ba-bfd1-95bf8b614140 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:08.279725 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-4a450381-6f5c-46ba-bfd1-95bf8b614140 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd734af142f64b2db23fc59dfde2fb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffc6ebebba5490f84b35ffb827b08d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:08.289834 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-4a450381-6f5c-46ba-bfd1-95bf8b614140 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] 10.222.0.62 "GET /compute/v2.1/servers/d90119a4-33d9-4e07-86fa-f0416da21dd4" status: 200 len: 1513 microversion: 2.1 time: 0.185488 Sep 01 16:46:08.290414 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 494/960] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:08 2022] GET /compute/v2.1/servers/d90119a4-33d9-4e07-86fa-f0416da21dd4 => generated 1513 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:09.318312 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-817f8e32-f256-402e-8778-d03126ad7052 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:09.319023 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-817f8e32-f256-402e-8778-d03126ad7052 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [instance: d90119a4-33d9-4e07-86fa-f0416da21dd4] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:09.325798 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-817f8e32-f256-402e-8778-d03126ad7052 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:09.326469 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-817f8e32-f256-402e-8778-d03126ad7052 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:09.326972 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-817f8e32-f256-402e-8778-d03126ad7052 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:09.327761 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-817f8e32-f256-402e-8778-d03126ad7052 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:09.328294 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-817f8e32-f256-402e-8778-d03126ad7052 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:09.328766 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-817f8e32-f256-402e-8778-d03126ad7052 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:09.483083 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-817f8e32-f256-402e-8778-d03126ad7052 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd734af142f64b2db23fc59dfde2fb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffc6ebebba5490f84b35ffb827b08d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:09.491220 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-817f8e32-f256-402e-8778-d03126ad7052 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] 10.222.0.62 "GET /compute/v2.1/servers/d90119a4-33d9-4e07-86fa-f0416da21dd4" status: 200 len: 1513 microversion: 2.1 time: 0.180669 Sep 01 16:46:09.491765 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 467/961] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:09 2022] GET /compute/v2.1/servers/d90119a4-33d9-4e07-86fa-f0416da21dd4 => generated 1513 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:10.202950 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-d3b62408-7dc1-4aa2-b8e6-1524ae7cc1a1 req-4fe102da-85f0-4ddd-936d-584d648c73f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d90119a4-33d9-4e07-86fa-f0416da21dd4", "name": "network-vif-deleted", "tag": "98dcd68b-8d89-4abb-b08d-fc12fa538eef"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:46:10.213943 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-d3b62408-7dc1-4aa2-b8e6-1524ae7cc1a1 req-4fe102da-85f0-4ddd-936d-584d648c73f1 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:10.214246 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-d3b62408-7dc1-4aa2-b8e6-1524ae7cc1a1 req-4fe102da-85f0-4ddd-936d-584d648c73f1 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:10.215171 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-d3b62408-7dc1-4aa2-b8e6-1524ae7cc1a1 req-4fe102da-85f0-4ddd-936d-584d648c73f1 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:10.226710 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-d3b62408-7dc1-4aa2-b8e6-1524ae7cc1a1 req-4fe102da-85f0-4ddd-936d-584d648c73f1 service nova] Creating event network-vif-deleted:98dcd68b-8d89-4abb-b08d-fc12fa538eef for instance d90119a4-33d9-4e07-86fa-f0416da21dd4 on hv-cinder-85221 Sep 01 16:46:10.232067 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-d3b62408-7dc1-4aa2-b8e6-1524ae7cc1a1 req-4fe102da-85f0-4ddd-936d-584d648c73f1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032777 Sep 01 16:46:10.232930 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 495/962] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:46:10.512678 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-65031f27-d046-4967-b41b-efec651d38d0 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:10.513438 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-65031f27-d046-4967-b41b-efec651d38d0 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [instance: d90119a4-33d9-4e07-86fa-f0416da21dd4] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:10.522446 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-65031f27-d046-4967-b41b-efec651d38d0 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:10.522940 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-65031f27-d046-4967-b41b-efec651d38d0 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:10.523372 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-65031f27-d046-4967-b41b-efec651d38d0 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:10.524116 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-65031f27-d046-4967-b41b-efec651d38d0 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:10.524565 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-65031f27-d046-4967-b41b-efec651d38d0 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:10.524987 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-65031f27-d046-4967-b41b-efec651d38d0 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:10.557590 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-65031f27-d046-4967-b41b-efec651d38d0 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:10.558060 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-65031f27-d046-4967-b41b-efec651d38d0 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:10.558485 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-65031f27-d046-4967-b41b-efec651d38d0 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:10.558931 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-65031f27-d046-4967-b41b-efec651d38d0 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lazy-loading 'fault' on Instance uuid d90119a4-33d9-4e07-86fa-f0416da21dd4 {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:46:10.751159 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-65031f27-d046-4967-b41b-efec651d38d0 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd734af142f64b2db23fc59dfde2fb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffc6ebebba5490f84b35ffb827b08d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:10.766891 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-65031f27-d046-4967-b41b-efec651d38d0 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] 10.222.0.62 "GET /compute/v2.1/servers/d90119a4-33d9-4e07-86fa-f0416da21dd4" status: 200 len: 1308 microversion: 2.1 time: 0.257889 Sep 01 16:46:10.767469 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 468/963] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:10 2022] GET /compute/v2.1/servers/d90119a4-33d9-4e07-86fa-f0416da21dd4 => generated 1308 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:11.790271 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0760ffce-da4d-4497-91b7-9d840c0a7b77 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:11.790953 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-0760ffce-da4d-4497-91b7-9d840c0a7b77 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] [instance: d90119a4-33d9-4e07-86fa-f0416da21dd4] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:11.797951 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0760ffce-da4d-4497-91b7-9d840c0a7b77 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:11.798441 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0760ffce-da4d-4497-91b7-9d840c0a7b77 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:11.798871 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0760ffce-da4d-4497-91b7-9d840c0a7b77 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:11.799571 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0760ffce-da4d-4497-91b7-9d840c0a7b77 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:11.800032 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0760ffce-da4d-4497-91b7-9d840c0a7b77 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:11.800457 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0760ffce-da4d-4497-91b7-9d840c0a7b77 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:11.814838 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-0760ffce-da4d-4497-91b7-9d840c0a7b77 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] HTTP exception thrown: Instance d90119a4-33d9-4e07-86fa-f0416da21dd4 could not be found. Sep 01 16:46:11.816529 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0760ffce-da4d-4497-91b7-9d840c0a7b77 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Request method failure captured: Sep 01 16:46:11.816529 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: request: GET /compute/v2.1/servers/d90119a4-33d9-4e07-86fa-f0416da21dd4 HTTP/1.1 Sep 01 16:46:11.816529 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 01 16:46:11.816529 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 01 16:46:11.816529 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Connection: close Sep 01 16:46:11.816529 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 01 16:46:11.816529 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 01 16:46:11.816529 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Host: 10.222.0.62 Sep 01 16:46:11.816529 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 01 16:46:11.816529 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 01 16:46:11.816529 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjEOFqOTewzaSnzZT__n-2ait2TuWubfzVW__uXptoFPxg7dnuutVKux8ASLJetu-sqeGuwN0uWaO-DKixbCOGr05LqWpRDZRH9lizYYjJr_ePR40Vh2DQj9HGuCMLvEeoagnyB-4QiWnP4Vteu5Eu-nfxMAUStaRfD0nQpbsstM78dE4 Sep 01 16:46:11.816529 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 01 16:46:11.816529 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 01 16:46:11.816529 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 01 16:46:11.816529 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 01 16:46:11.816529 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 01 16:46:11.816529 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 01 16:46:11.816529 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Id: 4ffc6ebebba5490f84b35ffb827b08d8 Sep 01 16:46:11.816529 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-VolumesSnapshotTestJSON-71662643 Sep 01 16:46:11.816529 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 01 16:46:11.816529 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 01 16:46:11.818878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4ffc6ebebba5490f84b35ffb827b08d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4ffc6ebebba5490f84b35ffb827b08d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4ffc6ebebba5490f84b35ffb827b08d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4ffc6ebebba5490f84b35ffb827b08d8"}]}] Sep 01 16:46:11.818878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-VolumesSnapshotTestJSON-71662643 Sep 01 16:46:11.818878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Id: 4ffc6ebebba5490f84b35ffb827b08d8 Sep 01 16:46:11.818878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-71662643 Sep 01 16:46:11.818878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User: tempest-VolumesSnapshotTestJSON-71662643-project Sep 01 16:46:11.818878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 01 16:46:11.818878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 01 16:46:11.818878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Id: fd734af142f64b2db23fc59dfde2fb0e Sep 01 16:46:11.818878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-VolumesSnapshotTestJSON-71662643-project Sep 01 16:46:11.818878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: method: > Sep 01 16:46:11.818878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: exception: Instance d90119a4-33d9-4e07-86fa-f0416da21dd4 could not be found. Sep 01 16:46:11.818878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: action_args: {'id': 'd90119a4-33d9-4e07-86fa-f0416da21dd4'} Sep 01 16:46:11.820229 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:46:11.820229 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:46:11.820229 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:46:11.820229 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:46:11.820229 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:46:11.820229 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:46:11.820229 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:46:11.820229 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:46:11.820229 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:46:11.820229 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:46:11.820229 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d90119a4-33d9-4e07-86fa-f0416da21dd4 could not be found. Sep 01 16:46:11.820229 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:46:11.820229 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:46:11.820229 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:46:11.820229 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:46:11.820229 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:46:11.820229 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:46:11.820229 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:46:11.820229 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:46:11.820229 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:46:11.822113 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:46:11.822113 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:46:11.822113 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:46:11.822113 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:46:11.822113 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:46:11.822113 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:46:11.822113 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:46:11.822113 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d90119a4-33d9-4e07-86fa-f0416da21dd4 could not be found. Sep 01 16:46:11.822113 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:46:11.822113 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:46:11.822113 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:46:11.822113 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:46:11.822113 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:46:11.822113 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:46:11.822113 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:46:11.822113 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:46:11.822113 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d90119a4-33d9-4e07-86fa-f0416da21dd4 could not be found. Sep 01 16:46:11.822113 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:46:11.823562 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0760ffce-da4d-4497-91b7-9d840c0a7b77 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] Returning 404 to user: Instance d90119a4-33d9-4e07-86fa-f0416da21dd4 could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:46:11.823562 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-0760ffce-da4d-4497-91b7-9d840c0a7b77 tempest-VolumesSnapshotTestJSON-71662643 tempest-VolumesSnapshotTestJSON-71662643-project] 10.222.0.62 "GET /compute/v2.1/servers/d90119a4-33d9-4e07-86fa-f0416da21dd4" status: 404 len: 111 microversion: 2.1 time: 0.032900 Sep 01 16:46:11.823562 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 496/964] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:11 2022] GET /compute/v2.1/servers/d90119a4-33d9-4e07-86fa-f0416da21dd4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:46:58.524193 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-ea2d51a4-3a07-4ccc-8e0e-4fee8fc12a42 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Action: 'create', calling method: .version_select at 0x7f9482229040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-597618003", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFI7ZwCR44CcHpcSTrv0MRzVwhricy2QFwdEPfJGOkT4FkA4qKARmqLL/PH5oMMVbBnkMJ/5q1/gatoDXcMKVpD/Xx6XTQHhj193spi5iXV2spClIMUbYTxYpHzADSR1g=="}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:46:58.529925 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:46:58.530589 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:46:58.532066 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 01 16:46:58.549903 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-ea2d51a4-3a07-4ccc-8e0e-4fee8fc12a42 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Getting quotas for project 3b373831f3c5412eb2170fef6580c110. Resources: {'key_pairs'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:46:58.554172 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.quota [None req-ea2d51a4-3a07-4ccc-8e0e-4fee8fc12a42 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Getting quotas for user d762a5837f034fc2aafa0efa33708530 and project 3b373831f3c5412eb2170fef6580c110. Resources: {'key_pairs'} {{(pid=127198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:46:58.583305 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-ea2d51a4-3a07-4ccc-8e0e-4fee8fc12a42 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.063362 Sep 01 16:46:58.583913 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 469/965] 10.222.0.62 () {60 vars in 1159 bytes} [Thu Sep 1 16:46:58 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:46:58.643680 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-9c3ade6f-916a-489b-b54a-047460809b4d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1436693629", "imageRef": "f4053f86-0cce-44f0-a990-1cbe9a2e4015", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-597618003", "networks": [{"uuid": "f3a5f741-94d1-405a-92f2-8a7002d1f1f2"}]}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:46:58.652670 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=8 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:46:58.653320 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:46:58.654710 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 01 16:46:58.834947 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.network.neutron [None req-9c3ade6f-916a-489b-b54a-047460809b4d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] validate_networks() for [('f3a5f741-94d1-405a-92f2-8a7002d1f1f2', None, None, None, None, None)] {{(pid=127199) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:46:59.270429 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-9c3ade6f-916a-489b-b54a-047460809b4d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Flavor limits 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:46:59.270853 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-9c3ade6f-916a-489b-b54a-047460809b4d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Image limits 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:46:59.271331 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-9c3ade6f-916a-489b-b54a-047460809b4d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Flavor pref 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:46:59.271730 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-9c3ade6f-916a-489b-b54a-047460809b4d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Image pref 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:46:59.272175 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-9c3ade6f-916a-489b-b54a-047460809b4d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:46:59.281729 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9c3ade6f-916a-489b-b54a-047460809b4d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:59.282233 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9c3ade6f-916a-489b-b54a-047460809b4d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:59.282662 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9c3ade6f-916a-489b-b54a-047460809b4d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:59.283394 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9c3ade6f-916a-489b-b54a-047460809b4d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:59.283847 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9c3ade6f-916a-489b-b54a-047460809b4d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:59.284301 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9c3ade6f-916a-489b-b54a-047460809b4d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:59.302428 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-9c3ade6f-916a-489b-b54a-047460809b4d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Getting quotas for project 3b373831f3c5412eb2170fef6580c110. Resources: {'ram', 'cores', 'instances'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:46:59.306738 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-9c3ade6f-916a-489b-b54a-047460809b4d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Getting quotas for user d762a5837f034fc2aafa0efa33708530 and project 3b373831f3c5412eb2170fef6580c110. Resources: {'ram', 'cores', 'instances'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:46:59.318134 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-9c3ade6f-916a-489b-b54a-047460809b4d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Going to run 1 instances... {{(pid=127199) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:46:59.320585 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-9c3ade6f-916a-489b-b54a-047460809b4d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f4053f86-0cce-44f0-a990-1cbe9a2e4015',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:46:59.370710 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-9c3ade6f-916a-489b-b54a-047460809b4d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.730617 Sep 01 16:46:59.371881 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 497/966] 10.222.0.62 () {60 vars in 1147 bytes} [Thu Sep 1 16:46:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:46:59.384508 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a25b96a3-e2f8-40a4-9a4c-6f76f0de39b0 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:59.385753 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a25b96a3-e2f8-40a4-9a4c-6f76f0de39b0 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:59.460406 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a25b96a3-e2f8-40a4-9a4c-6f76f0de39b0 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd762a5837f034fc2aafa0efa33708530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b373831f3c5412eb2170fef6580c110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:59.473540 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a25b96a3-e2f8-40a4-9a4c-6f76f0de39b0 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149" status: 200 len: 1258 microversion: 2.1 time: 0.093616 Sep 01 16:46:59.474513 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 470/967] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:59 2022] GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149 => generated 1258 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:00.496940 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8d360230-76f0-432f-836b-e00a349aea51 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:00.497540 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-8d360230-76f0-432f-836b-e00a349aea51 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:00.505323 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8d360230-76f0-432f-836b-e00a349aea51 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:00.505830 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8d360230-76f0-432f-836b-e00a349aea51 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:00.506268 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8d360230-76f0-432f-836b-e00a349aea51 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:00.506995 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8d360230-76f0-432f-836b-e00a349aea51 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:00.507449 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8d360230-76f0-432f-836b-e00a349aea51 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:00.507912 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8d360230-76f0-432f-836b-e00a349aea51 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:00.583608 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8d360230-76f0-432f-836b-e00a349aea51 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd762a5837f034fc2aafa0efa33708530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b373831f3c5412eb2170fef6580c110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:00.594946 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8d360230-76f0-432f-836b-e00a349aea51 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149" status: 200 len: 1310 microversion: 2.1 time: 0.102625 Sep 01 16:47:00.595641 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 498/968] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:00 2022] GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149 => generated 1310 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:01.619400 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c3c76aa1-9a08-4c7f-ba1d-7e8bd97aefdb tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:01.621118 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c3c76aa1-9a08-4c7f-ba1d-7e8bd97aefdb tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:01.633987 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c3c76aa1-9a08-4c7f-ba1d-7e8bd97aefdb tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:01.636027 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c3c76aa1-9a08-4c7f-ba1d-7e8bd97aefdb tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:01.637537 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c3c76aa1-9a08-4c7f-ba1d-7e8bd97aefdb tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:01.639473 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c3c76aa1-9a08-4c7f-ba1d-7e8bd97aefdb tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:01.641346 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c3c76aa1-9a08-4c7f-ba1d-7e8bd97aefdb tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:01.647913 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c3c76aa1-9a08-4c7f-ba1d-7e8bd97aefdb tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:01.794158 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c3c76aa1-9a08-4c7f-ba1d-7e8bd97aefdb tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd762a5837f034fc2aafa0efa33708530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b373831f3c5412eb2170fef6580c110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:01.806730 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c3c76aa1-9a08-4c7f-ba1d-7e8bd97aefdb tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149" status: 200 len: 1316 microversion: 2.1 time: 0.191507 Sep 01 16:47:01.807730 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 471/969] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:01 2022] GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149 => generated 1316 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:02.833996 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-9c4e26ab-3d14-4b13-aaad-420f505673cd tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:02.835423 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-9c4e26ab-3d14-4b13-aaad-420f505673cd tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:02.843316 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9c4e26ab-3d14-4b13-aaad-420f505673cd tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:02.843959 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9c4e26ab-3d14-4b13-aaad-420f505673cd tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:02.844962 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9c4e26ab-3d14-4b13-aaad-420f505673cd tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:02.844962 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9c4e26ab-3d14-4b13-aaad-420f505673cd tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:02.846309 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9c4e26ab-3d14-4b13-aaad-420f505673cd tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:02.846477 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9c4e26ab-3d14-4b13-aaad-420f505673cd tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:03.017825 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-9c4e26ab-3d14-4b13-aaad-420f505673cd tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd762a5837f034fc2aafa0efa33708530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b373831f3c5412eb2170fef6580c110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:03.027172 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-9c4e26ab-3d14-4b13-aaad-420f505673cd tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149" status: 200 len: 1358 microversion: 2.1 time: 0.198788 Sep 01 16:47:03.027990 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 499/970] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:02 2022] GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149 => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:04.056276 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1012e61e-2c13-4e28-b0e6-fae3a3cb512a tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:04.057960 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1012e61e-2c13-4e28-b0e6-fae3a3cb512a tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:04.065958 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1012e61e-2c13-4e28-b0e6-fae3a3cb512a tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:04.067911 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1012e61e-2c13-4e28-b0e6-fae3a3cb512a tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:04.068390 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1012e61e-2c13-4e28-b0e6-fae3a3cb512a tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:04.069166 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1012e61e-2c13-4e28-b0e6-fae3a3cb512a tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:04.069632 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1012e61e-2c13-4e28-b0e6-fae3a3cb512a tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:04.070060 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1012e61e-2c13-4e28-b0e6-fae3a3cb512a tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:04.277624 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1012e61e-2c13-4e28-b0e6-fae3a3cb512a tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd762a5837f034fc2aafa0efa33708530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b373831f3c5412eb2170fef6580c110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:04.291050 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1012e61e-2c13-4e28-b0e6-fae3a3cb512a tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149" status: 200 len: 1358 microversion: 2.1 time: 0.244048 Sep 01 16:47:04.292853 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 472/971] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:04 2022] GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149 => generated 1358 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:05.315564 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ad284e38-ab4f-4f18-94fd-96a6d2120acd tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:05.316790 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ad284e38-ab4f-4f18-94fd-96a6d2120acd tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:05.327210 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ad284e38-ab4f-4f18-94fd-96a6d2120acd tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:05.327870 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ad284e38-ab4f-4f18-94fd-96a6d2120acd tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:05.328548 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ad284e38-ab4f-4f18-94fd-96a6d2120acd tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:05.329438 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ad284e38-ab4f-4f18-94fd-96a6d2120acd tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:05.330015 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ad284e38-ab4f-4f18-94fd-96a6d2120acd tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:05.330522 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ad284e38-ab4f-4f18-94fd-96a6d2120acd tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:05.542948 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ad284e38-ab4f-4f18-94fd-96a6d2120acd tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd762a5837f034fc2aafa0efa33708530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b373831f3c5412eb2170fef6580c110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:05.555377 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ad284e38-ab4f-4f18-94fd-96a6d2120acd tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149" status: 200 len: 1358 microversion: 2.1 time: 0.246314 Sep 01 16:47:05.556287 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 500/972] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:05 2022] GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149 => generated 1358 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:05.707779 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b1d2694c-f5fe-483b-9e05-14854e77ac72 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:05.708889 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b1d2694c-f5fe-483b-9e05-14854e77ac72 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 267fca3e-c9de-44ba-a888-8443d96fc9c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:05.721745 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b1d2694c-f5fe-483b-9e05-14854e77ac72 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:05.722722 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b1d2694c-f5fe-483b-9e05-14854e77ac72 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:05.723484 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b1d2694c-f5fe-483b-9e05-14854e77ac72 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:05.724736 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b1d2694c-f5fe-483b-9e05-14854e77ac72 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:05.725545 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b1d2694c-f5fe-483b-9e05-14854e77ac72 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:05.726268 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b1d2694c-f5fe-483b-9e05-14854e77ac72 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:05.781030 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b1d2694c-f5fe-483b-9e05-14854e77ac72 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 267fca3e-c9de-44ba-a888-8443d96fc9c8] Going to try to terminate instance {{(pid=127198) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:47:05.900190 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b1d2694c-f5fe-483b-9e05-14854e77ac72 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "DELETE /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8" status: 204 len: 0 microversion: 2.1 time: 0.197326 Sep 01 16:47:05.901982 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 473/973] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Sep 1 16:47:05 2022] DELETE /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:47:05.912506 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ad056adb-ad8d-4be0-a534-c277b86fc05d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:05.913253 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ad056adb-ad8d-4be0-a534-c277b86fc05d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 267fca3e-c9de-44ba-a888-8443d96fc9c8] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:05.921864 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ad056adb-ad8d-4be0-a534-c277b86fc05d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:05.922341 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ad056adb-ad8d-4be0-a534-c277b86fc05d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:05.922779 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ad056adb-ad8d-4be0-a534-c277b86fc05d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:05.923577 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ad056adb-ad8d-4be0-a534-c277b86fc05d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:05.924103 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ad056adb-ad8d-4be0-a534-c277b86fc05d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:05.924587 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ad056adb-ad8d-4be0-a534-c277b86fc05d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:06.101801 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ad056adb-ad8d-4be0-a534-c277b86fc05d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:06.114159 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ad056adb-ad8d-4be0-a534-c277b86fc05d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8" status: 200 len: 1578 microversion: 2.1 time: 0.207314 Sep 01 16:47:06.115670 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 501/974] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:05 2022] GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8 => generated 1578 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:06.581699 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-8ad00ac3-c7ed-4879-b4af-ca8394d5bb53 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:06.583176 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-8ad00ac3-c7ed-4879-b4af-ca8394d5bb53 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:06.591085 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8ad00ac3-c7ed-4879-b4af-ca8394d5bb53 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:06.591988 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8ad00ac3-c7ed-4879-b4af-ca8394d5bb53 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:06.592718 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8ad00ac3-c7ed-4879-b4af-ca8394d5bb53 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:06.593513 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8ad00ac3-c7ed-4879-b4af-ca8394d5bb53 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:06.593989 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8ad00ac3-c7ed-4879-b4af-ca8394d5bb53 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:06.594728 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-8ad00ac3-c7ed-4879-b4af-ca8394d5bb53 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:06.820793 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-8ad00ac3-c7ed-4879-b4af-ca8394d5bb53 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd762a5837f034fc2aafa0efa33708530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b373831f3c5412eb2170fef6580c110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:06.839511 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-8ad00ac3-c7ed-4879-b4af-ca8394d5bb53 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149" status: 200 len: 1358 microversion: 2.1 time: 0.263637 Sep 01 16:47:06.840722 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 474/975] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:06 2022] GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149 => generated 1358 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:47:07.149963 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-dbf65424-283d-4676-9204-e1237919d12d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:07.151028 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-dbf65424-283d-4676-9204-e1237919d12d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 267fca3e-c9de-44ba-a888-8443d96fc9c8] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:07.158644 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dbf65424-283d-4676-9204-e1237919d12d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:07.159153 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dbf65424-283d-4676-9204-e1237919d12d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:07.161127 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dbf65424-283d-4676-9204-e1237919d12d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:07.161952 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dbf65424-283d-4676-9204-e1237919d12d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:07.162436 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dbf65424-283d-4676-9204-e1237919d12d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:07.162869 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dbf65424-283d-4676-9204-e1237919d12d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:07.368348 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-dbf65424-283d-4676-9204-e1237919d12d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:07.378783 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-dbf65424-283d-4676-9204-e1237919d12d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8" status: 200 len: 1578 microversion: 2.1 time: 0.234200 Sep 01 16:47:07.394351 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 502/976] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:07 2022] GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8 => generated 1578 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:47:07.873268 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7952044f-c9a9-4fad-8453-d76985e9ee55 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:07.873911 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7952044f-c9a9-4fad-8453-d76985e9ee55 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:07.882095 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7952044f-c9a9-4fad-8453-d76985e9ee55 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:07.882608 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7952044f-c9a9-4fad-8453-d76985e9ee55 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:07.883050 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7952044f-c9a9-4fad-8453-d76985e9ee55 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:07.883768 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7952044f-c9a9-4fad-8453-d76985e9ee55 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:07.884444 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7952044f-c9a9-4fad-8453-d76985e9ee55 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:07.885117 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7952044f-c9a9-4fad-8453-d76985e9ee55 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:08.077483 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7952044f-c9a9-4fad-8453-d76985e9ee55 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd762a5837f034fc2aafa0efa33708530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b373831f3c5412eb2170fef6580c110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:08.093888 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7952044f-c9a9-4fad-8453-d76985e9ee55 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149" status: 200 len: 1358 microversion: 2.1 time: 0.225898 Sep 01 16:47:08.101681 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 475/977] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:07 2022] GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149 => generated 1358 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:08.402404 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-5a1d745d-8d7b-41ad-aea5-dc5f58983483 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:08.403242 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-5a1d745d-8d7b-41ad-aea5-dc5f58983483 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 267fca3e-c9de-44ba-a888-8443d96fc9c8] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:08.410547 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5a1d745d-8d7b-41ad-aea5-dc5f58983483 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:08.411051 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5a1d745d-8d7b-41ad-aea5-dc5f58983483 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:08.411480 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5a1d745d-8d7b-41ad-aea5-dc5f58983483 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:08.412224 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5a1d745d-8d7b-41ad-aea5-dc5f58983483 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:08.412730 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5a1d745d-8d7b-41ad-aea5-dc5f58983483 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:08.413092 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5a1d745d-8d7b-41ad-aea5-dc5f58983483 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:08.579016 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-5a1d745d-8d7b-41ad-aea5-dc5f58983483 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:08.589964 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-5a1d745d-8d7b-41ad-aea5-dc5f58983483 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8" status: 200 len: 1578 microversion: 2.1 time: 0.191388 Sep 01 16:47:08.590469 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 503/978] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:08 2022] GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8 => generated 1578 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:47:09.124541 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f24edfd8-6a97-4e76-9752-7bd54b45afc6 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:09.125173 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f24edfd8-6a97-4e76-9752-7bd54b45afc6 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:09.133054 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f24edfd8-6a97-4e76-9752-7bd54b45afc6 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:09.133680 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f24edfd8-6a97-4e76-9752-7bd54b45afc6 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:09.134130 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f24edfd8-6a97-4e76-9752-7bd54b45afc6 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:09.134901 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f24edfd8-6a97-4e76-9752-7bd54b45afc6 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:09.135370 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f24edfd8-6a97-4e76-9752-7bd54b45afc6 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:09.135810 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f24edfd8-6a97-4e76-9752-7bd54b45afc6 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:09.402365 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f24edfd8-6a97-4e76-9752-7bd54b45afc6 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd762a5837f034fc2aafa0efa33708530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b373831f3c5412eb2170fef6580c110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:09.410592 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f24edfd8-6a97-4e76-9752-7bd54b45afc6 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149" status: 200 len: 1358 microversion: 2.1 time: 0.289967 Sep 01 16:47:09.411201 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 476/979] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:09 2022] GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149 => generated 1358 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:09.615270 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-f1576201-2db7-419f-ba22-698e4fd52e54 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:09.616119 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-f1576201-2db7-419f-ba22-698e4fd52e54 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 267fca3e-c9de-44ba-a888-8443d96fc9c8] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:09.618494 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=2 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:09.619191 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=6 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:09.625993 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f1576201-2db7-419f-ba22-698e4fd52e54 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:09.626499 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f1576201-2db7-419f-ba22-698e4fd52e54 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:09.626943 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f1576201-2db7-419f-ba22-698e4fd52e54 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:09.627668 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f1576201-2db7-419f-ba22-698e4fd52e54 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:09.628155 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f1576201-2db7-419f-ba22-698e4fd52e54 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:09.628587 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f1576201-2db7-419f-ba22-698e4fd52e54 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:09.870300 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-cfa3e590-fd11-4e5b-b40e-db6f7227b55d req-d57d84a3-35a1-4a8f-80e1-cd3a31e08289 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb0c97da-94e3-4074-bc30-315c7bd7f149", "tag": "16e95cfd-eabb-4756-aff5-3331cb2f2007"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:47:09.876129 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=6 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:09.882416 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-cfa3e590-fd11-4e5b-b40e-db6f7227b55d req-d57d84a3-35a1-4a8f-80e1-cd3a31e08289 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:09.882927 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-cfa3e590-fd11-4e5b-b40e-db6f7227b55d req-d57d84a3-35a1-4a8f-80e1-cd3a31e08289 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:09.883362 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-cfa3e590-fd11-4e5b-b40e-db6f7227b55d req-d57d84a3-35a1-4a8f-80e1-cd3a31e08289 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:09.896845 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-f1576201-2db7-419f-ba22-698e4fd52e54 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:09.898164 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-cfa3e590-fd11-4e5b-b40e-db6f7227b55d req-d57d84a3-35a1-4a8f-80e1-cd3a31e08289 service nova] Creating event network-changed:16e95cfd-eabb-4756-aff5-3331cb2f2007 for instance eb0c97da-94e3-4074-bc30-315c7bd7f149 on hv-cinder-85221 Sep 01 16:47:09.906389 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-cfa3e590-fd11-4e5b-b40e-db6f7227b55d req-d57d84a3-35a1-4a8f-80e1-cd3a31e08289 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039560 Sep 01 16:47:09.907040 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-f1576201-2db7-419f-ba22-698e4fd52e54 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8" status: 200 len: 1578 microversion: 2.1 time: 0.298216 Sep 01 16:47:09.907743 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 477/980] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:47:09.907906 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 504/981] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:09 2022] GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8 => generated 1578 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:47:10.443598 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-4470995d-0899-4bd0-b6ea-28140bf36b3f tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:10.444483 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-4470995d-0899-4bd0-b6ea-28140bf36b3f tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:10.453374 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4470995d-0899-4bd0-b6ea-28140bf36b3f tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:10.453881 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4470995d-0899-4bd0-b6ea-28140bf36b3f tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:10.454385 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4470995d-0899-4bd0-b6ea-28140bf36b3f tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:10.455449 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4470995d-0899-4bd0-b6ea-28140bf36b3f tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:10.456064 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4470995d-0899-4bd0-b6ea-28140bf36b3f tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:10.456640 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-4470995d-0899-4bd0-b6ea-28140bf36b3f tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:10.826674 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-4470995d-0899-4bd0-b6ea-28140bf36b3f tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd762a5837f034fc2aafa0efa33708530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b373831f3c5412eb2170fef6580c110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:10.836314 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-4470995d-0899-4bd0-b6ea-28140bf36b3f tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149" status: 200 len: 1358 microversion: 2.1 time: 0.398481 Sep 01 16:47:10.837317 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 478/982] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:10 2022] GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149 => generated 1358 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:10.931128 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7119d10c-4859-4c99-acb6-5ed7495c1f9a tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:10.932227 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-7119d10c-4859-4c99-acb6-5ed7495c1f9a tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 267fca3e-c9de-44ba-a888-8443d96fc9c8] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:10.943958 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7119d10c-4859-4c99-acb6-5ed7495c1f9a tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:10.944470 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7119d10c-4859-4c99-acb6-5ed7495c1f9a tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:10.945108 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7119d10c-4859-4c99-acb6-5ed7495c1f9a tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:10.945849 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7119d10c-4859-4c99-acb6-5ed7495c1f9a tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:10.946531 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7119d10c-4859-4c99-acb6-5ed7495c1f9a tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:10.946968 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7119d10c-4859-4c99-acb6-5ed7495c1f9a tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:11.263689 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-7119d10c-4859-4c99-acb6-5ed7495c1f9a tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:11.273558 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-7119d10c-4859-4c99-acb6-5ed7495c1f9a tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8" status: 200 len: 1578 microversion: 2.1 time: 0.347110 Sep 01 16:47:11.274190 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 505/983] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:10 2022] GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8 => generated 1578 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:11.860393 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-85fa9e27-aa3b-4cea-8c96-a113b20d53e3 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:11.861049 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-85fa9e27-aa3b-4cea-8c96-a113b20d53e3 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:11.869322 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-85fa9e27-aa3b-4cea-8c96-a113b20d53e3 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:11.869985 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-85fa9e27-aa3b-4cea-8c96-a113b20d53e3 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:11.870536 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-85fa9e27-aa3b-4cea-8c96-a113b20d53e3 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:11.871494 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-85fa9e27-aa3b-4cea-8c96-a113b20d53e3 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:11.872017 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-85fa9e27-aa3b-4cea-8c96-a113b20d53e3 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:11.872650 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-85fa9e27-aa3b-4cea-8c96-a113b20d53e3 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:12.111315 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-335415f0-ae80-4eef-9628-c8da77542301 req-dd2ada22-2b92-447e-9097-01e8abf74252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "267fca3e-c9de-44ba-a888-8443d96fc9c8", "name": "network-vif-deleted", "tag": "7eec2532-2b18-4d3f-93b9-c8294bd927c2"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:47:12.117425 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-85fa9e27-aa3b-4cea-8c96-a113b20d53e3 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd762a5837f034fc2aafa0efa33708530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b373831f3c5412eb2170fef6580c110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:12.125385 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-85fa9e27-aa3b-4cea-8c96-a113b20d53e3 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149" status: 200 len: 1358 microversion: 2.1 time: 0.270497 Sep 01 16:47:12.125644 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-335415f0-ae80-4eef-9628-c8da77542301 req-dd2ada22-2b92-447e-9097-01e8abf74252 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:12.125882 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-335415f0-ae80-4eef-9628-c8da77542301 req-dd2ada22-2b92-447e-9097-01e8abf74252 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:12.126309 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-335415f0-ae80-4eef-9628-c8da77542301 req-dd2ada22-2b92-447e-9097-01e8abf74252 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:12.139570 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-335415f0-ae80-4eef-9628-c8da77542301 req-dd2ada22-2b92-447e-9097-01e8abf74252 service nova] Creating event network-vif-deleted:7eec2532-2b18-4d3f-93b9-c8294bd927c2 for instance 267fca3e-c9de-44ba-a888-8443d96fc9c8 on hv-cinder-85221 Sep 01 16:47:12.140239 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 479/984] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:11 2022] GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149 => generated 1358 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:12.145888 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-335415f0-ae80-4eef-9628-c8da77542301 req-dd2ada22-2b92-447e-9097-01e8abf74252 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038407 Sep 01 16:47:12.146498 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 506/985] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:47:12.300406 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-5bd83bba-10b1-4c2b-b7e2-285b0e0173c6 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:12.301472 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-5bd83bba-10b1-4c2b-b7e2-285b0e0173c6 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 267fca3e-c9de-44ba-a888-8443d96fc9c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:12.314707 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5bd83bba-10b1-4c2b-b7e2-285b0e0173c6 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:12.315285 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5bd83bba-10b1-4c2b-b7e2-285b0e0173c6 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:12.315805 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5bd83bba-10b1-4c2b-b7e2-285b0e0173c6 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:12.316738 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5bd83bba-10b1-4c2b-b7e2-285b0e0173c6 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:12.317281 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5bd83bba-10b1-4c2b-b7e2-285b0e0173c6 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:12.318033 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-5bd83bba-10b1-4c2b-b7e2-285b0e0173c6 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:12.389384 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-5bd83bba-10b1-4c2b-b7e2-285b0e0173c6 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:12.398344 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-5bd83bba-10b1-4c2b-b7e2-285b0e0173c6 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8" status: 200 len: 1226 microversion: 2.1 time: 0.102270 Sep 01 16:47:12.398940 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 480/986] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:12 2022] GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8 => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:13.149878 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-fba4ae9d-4695-4b4c-86e6-a838a7282130 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:13.150865 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-fba4ae9d-4695-4b4c-86e6-a838a7282130 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:13.160171 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fba4ae9d-4695-4b4c-86e6-a838a7282130 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:13.160910 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fba4ae9d-4695-4b4c-86e6-a838a7282130 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:13.161371 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fba4ae9d-4695-4b4c-86e6-a838a7282130 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:13.162101 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fba4ae9d-4695-4b4c-86e6-a838a7282130 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:13.162670 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fba4ae9d-4695-4b4c-86e6-a838a7282130 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:13.163220 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fba4ae9d-4695-4b4c-86e6-a838a7282130 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:13.328968 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-fba4ae9d-4695-4b4c-86e6-a838a7282130 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd762a5837f034fc2aafa0efa33708530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b373831f3c5412eb2170fef6580c110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:13.337257 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-fba4ae9d-4695-4b4c-86e6-a838a7282130 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149" status: 200 len: 1358 microversion: 2.1 time: 0.192602 Sep 01 16:47:13.337848 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 507/987] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:13 2022] GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149 => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:13.420042 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-261e57a7-a482-42c6-815b-4360c6ba95ea tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:13.421401 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-261e57a7-a482-42c6-815b-4360c6ba95ea tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 267fca3e-c9de-44ba-a888-8443d96fc9c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:13.430668 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-261e57a7-a482-42c6-815b-4360c6ba95ea tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:13.431447 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-261e57a7-a482-42c6-815b-4360c6ba95ea tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:13.432159 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-261e57a7-a482-42c6-815b-4360c6ba95ea tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:13.433368 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-261e57a7-a482-42c6-815b-4360c6ba95ea tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:13.433997 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-261e57a7-a482-42c6-815b-4360c6ba95ea tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:13.434645 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-261e57a7-a482-42c6-815b-4360c6ba95ea tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:13.451687 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-261e57a7-a482-42c6-815b-4360c6ba95ea tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] HTTP exception thrown: Instance 267fca3e-c9de-44ba-a888-8443d96fc9c8 could not be found. Sep 01 16:47:13.453398 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-261e57a7-a482-42c6-815b-4360c6ba95ea tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Request method failure captured: Sep 01 16:47:13.453398 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: request: GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8 HTTP/1.1 Sep 01 16:47:13.453398 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 01 16:47:13.453398 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 01 16:47:13.453398 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Connection: close Sep 01 16:47:13.453398 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 01 16:47:13.453398 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 01 16:47:13.453398 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Host: 10.222.0.62 Sep 01 16:47:13.453398 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 01 16:47:13.453398 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 01 16:47:13.453398 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjEOFgxM7SaieoAVHA3hJou9qbkQrDjV5SqFBHn9XOJxMUKZXdkp9ZNIp6jWYJ9WSbYIbpl-W4btkQ83Ls3MwrHbPLI1Mv4f8gTDSyCBjzpa9fbk1LsAfvVcdF3jiT22rYU2vS8wDFAGEDLHUGdEnIsOL3LBpvrta62S0uXl3RwkWed14 Sep 01 16:47:13.453398 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 01 16:47:13.453398 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 01 16:47:13.453398 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 01 16:47:13.453398 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 01 16:47:13.453398 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 01 16:47:13.453398 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 01 16:47:13.453398 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Id: ec4d86f1d7bc4cc9a39ff55d4dc6a801 Sep 01 16:47:13.453398 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-TestVolumeBootPattern-1869658126 Sep 01 16:47:13.453398 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 01 16:47:13.453398 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 01 16:47:13.455162 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ec4d86f1d7bc4cc9a39ff55d4dc6a801"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ec4d86f1d7bc4cc9a39ff55d4dc6a801"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ec4d86f1d7bc4cc9a39ff55d4dc6a801"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ec4d86f1d7bc4cc9a39ff55d4dc6a801"}]}] Sep 01 16:47:13.455162 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-TestVolumeBootPattern-1869658126 Sep 01 16:47:13.455162 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Id: ec4d86f1d7bc4cc9a39ff55d4dc6a801 Sep 01 16:47:13.455162 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-TestVolumeBootPattern-1869658126 Sep 01 16:47:13.455162 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User: tempest-TestVolumeBootPattern-1869658126-project Sep 01 16:47:13.455162 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 01 16:47:13.455162 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 01 16:47:13.455162 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Id: ed4710f614cc431683a9c2a4f3d9d7b6 Sep 01 16:47:13.455162 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-TestVolumeBootPattern-1869658126-project Sep 01 16:47:13.455162 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: method: > Sep 01 16:47:13.455162 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: exception: Instance 267fca3e-c9de-44ba-a888-8443d96fc9c8 could not be found. Sep 01 16:47:13.455162 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: action_args: {'id': '267fca3e-c9de-44ba-a888-8443d96fc9c8'} Sep 01 16:47:13.456359 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:47:13.456359 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:47:13.456359 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:47:13.456359 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:47:13.456359 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:47:13.456359 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:47:13.456359 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:47:13.456359 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:47:13.456359 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:47:13.456359 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:47:13.456359 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 267fca3e-c9de-44ba-a888-8443d96fc9c8 could not be found. Sep 01 16:47:13.456359 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:47:13.456359 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:47:13.456359 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:47:13.456359 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:47:13.456359 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:47:13.456359 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:47:13.456359 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:47:13.456359 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:47:13.456359 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:47:13.457890 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:47:13.457890 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:47:13.457890 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:47:13.457890 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:47:13.457890 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:47:13.457890 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:47:13.457890 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:47:13.457890 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 267fca3e-c9de-44ba-a888-8443d96fc9c8 could not be found. Sep 01 16:47:13.457890 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:47:13.457890 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:47:13.457890 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:47:13.457890 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:47:13.457890 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:47:13.457890 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:47:13.457890 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:47:13.457890 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:47:13.457890 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 267fca3e-c9de-44ba-a888-8443d96fc9c8 could not be found. Sep 01 16:47:13.457890 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:47:13.459325 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-261e57a7-a482-42c6-815b-4360c6ba95ea tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Returning 404 to user: Instance 267fca3e-c9de-44ba-a888-8443d96fc9c8 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:47:13.459325 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-261e57a7-a482-42c6-815b-4360c6ba95ea tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8" status: 404 len: 111 microversion: 2.1 time: 0.039547 Sep 01 16:47:13.459325 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 481/988] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:13 2022] GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:47:13.575287 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-eb29e93f-76ae-4020-b41d-66b50f9a90ac tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2107424800", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1926683814", "security_groups": [{"name": "tempest-secgroup-smoke-505739473"}], "block_device_mapping_v2": [{"uuid": "7dd96d4f-a09d-4c32-bb0c-168256237f37", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d4d42d28-c5d6-49fb-b45c-004cc9c36c1c"}]}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:47:13.719149 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.network.neutron [None req-eb29e93f-76ae-4020-b41d-66b50f9a90ac tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] validate_networks() for [('d4d42d28-c5d6-49fb-b45c-004cc9c36c1c', None, None, None, None, None)] {{(pid=127199) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:47:14.126515 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-eb29e93f-76ae-4020-b41d-66b50f9a90ac tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Flavor limits 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:47:14.126930 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-eb29e93f-76ae-4020-b41d-66b50f9a90ac tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Image limits 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:47:14.127397 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-eb29e93f-76ae-4020-b41d-66b50f9a90ac tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Flavor pref 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:47:14.127910 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-eb29e93f-76ae-4020-b41d-66b50f9a90ac tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Image pref 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:47:14.128324 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-eb29e93f-76ae-4020-b41d-66b50f9a90ac tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:47:14.137988 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eb29e93f-76ae-4020-b41d-66b50f9a90ac tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:14.138488 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eb29e93f-76ae-4020-b41d-66b50f9a90ac tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:14.138916 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eb29e93f-76ae-4020-b41d-66b50f9a90ac tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:14.139667 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eb29e93f-76ae-4020-b41d-66b50f9a90ac tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:14.140184 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eb29e93f-76ae-4020-b41d-66b50f9a90ac tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:14.140590 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eb29e93f-76ae-4020-b41d-66b50f9a90ac tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:14.159162 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-eb29e93f-76ae-4020-b41d-66b50f9a90ac tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Getting quotas for project ec4d86f1d7bc4cc9a39ff55d4dc6a801. Resources: {'ram', 'cores', 'instances'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:47:14.163648 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-eb29e93f-76ae-4020-b41d-66b50f9a90ac tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Getting quotas for user ed4710f614cc431683a9c2a4f3d9d7b6 and project ec4d86f1d7bc4cc9a39ff55d4dc6a801. Resources: {'ram', 'cores', 'instances'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:47:14.224028 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-eb29e93f-76ae-4020-b41d-66b50f9a90ac tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Going to run 1 instances... {{(pid=127199) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:47:14.226193 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-eb29e93f-76ae-4020-b41d-66b50f9a90ac tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: b402a148-2510-4b7a-99ff-71ac77e3854f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7dd96d4f-a09d-4c32-bb0c-168256237f37',volume_size=None,volume_type=None)] {{(pid=127199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:47:14.358690 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-408e8c86-bee7-4639-916b-b94a11d887ee tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:14.359625 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-408e8c86-bee7-4639-916b-b94a11d887ee tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:14.367077 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-408e8c86-bee7-4639-916b-b94a11d887ee tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:14.367570 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-408e8c86-bee7-4639-916b-b94a11d887ee tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:14.368036 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-408e8c86-bee7-4639-916b-b94a11d887ee tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:14.368743 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-408e8c86-bee7-4639-916b-b94a11d887ee tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:14.369196 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-408e8c86-bee7-4639-916b-b94a11d887ee tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:14.369632 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-408e8c86-bee7-4639-916b-b94a11d887ee tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:14.375126 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-eb29e93f-76ae-4020-b41d-66b50f9a90ac tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.805937 Sep 01 16:47:14.375663 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 508/989] 10.222.0.62 () {60 vars in 1147 bytes} [Thu Sep 1 16:47:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:47:14.389799 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-2d32883d-4078-47d5-8d02-9691f45bda6d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:14.390600 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-2d32883d-4078-47d5-8d02-9691f45bda6d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: b402a148-2510-4b7a-99ff-71ac77e3854f] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:14.471749 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-2d32883d-4078-47d5-8d02-9691f45bda6d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:14.483772 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-2d32883d-4078-47d5-8d02-9691f45bda6d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/b402a148-2510-4b7a-99ff-71ac77e3854f" status: 200 len: 1095 microversion: 2.1 time: 0.097710 Sep 01 16:47:14.487371 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 509/990] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:14 2022] GET /compute/v2.1/servers/b402a148-2510-4b7a-99ff-71ac77e3854f => generated 1095 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:14.551092 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-408e8c86-bee7-4639-916b-b94a11d887ee tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd762a5837f034fc2aafa0efa33708530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b373831f3c5412eb2170fef6580c110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:14.559652 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-408e8c86-bee7-4639-916b-b94a11d887ee tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149" status: 200 len: 1358 microversion: 2.1 time: 0.205327 Sep 01 16:47:14.560309 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 482/991] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:14 2022] GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149 => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:15.507514 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-37b601aa-85c3-412b-a970-2ade0a016bad tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:15.508312 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-37b601aa-85c3-412b-a970-2ade0a016bad tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: b402a148-2510-4b7a-99ff-71ac77e3854f] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:15.516437 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-37b601aa-85c3-412b-a970-2ade0a016bad tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:15.516935 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-37b601aa-85c3-412b-a970-2ade0a016bad tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:15.517349 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-37b601aa-85c3-412b-a970-2ade0a016bad tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:15.518248 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-37b601aa-85c3-412b-a970-2ade0a016bad tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:15.518707 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-37b601aa-85c3-412b-a970-2ade0a016bad tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:15.519653 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-37b601aa-85c3-412b-a970-2ade0a016bad tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:15.582231 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-6d8cbaae-2c71-40b6-b8fb-99efce4ffc22 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:15.582998 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-6d8cbaae-2c71-40b6-b8fb-99efce4ffc22 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:15.591984 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6d8cbaae-2c71-40b6-b8fb-99efce4ffc22 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:15.593009 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6d8cbaae-2c71-40b6-b8fb-99efce4ffc22 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:15.593458 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6d8cbaae-2c71-40b6-b8fb-99efce4ffc22 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:15.594269 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6d8cbaae-2c71-40b6-b8fb-99efce4ffc22 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:15.594767 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6d8cbaae-2c71-40b6-b8fb-99efce4ffc22 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:15.595257 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-6d8cbaae-2c71-40b6-b8fb-99efce4ffc22 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:15.653367 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-37b601aa-85c3-412b-a970-2ade0a016bad tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:15.665307 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-37b601aa-85c3-412b-a970-2ade0a016bad tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/b402a148-2510-4b7a-99ff-71ac77e3854f" status: 200 len: 1201 microversion: 2.1 time: 0.162139 Sep 01 16:47:15.666525 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 510/992] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:15 2022] GET /compute/v2.1/servers/b402a148-2510-4b7a-99ff-71ac77e3854f => generated 1201 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:15.851230 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-6d8cbaae-2c71-40b6-b8fb-99efce4ffc22 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd762a5837f034fc2aafa0efa33708530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b373831f3c5412eb2170fef6580c110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:15.860555 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-6d8cbaae-2c71-40b6-b8fb-99efce4ffc22 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149" status: 200 len: 1358 microversion: 2.1 time: 0.282420 Sep 01 16:47:15.861153 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 483/993] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:15 2022] GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149 => generated 1358 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:47:16.687829 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7f93e0bb-72c1-4e7d-8f01-65eed26d5931 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:16.688810 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-7f93e0bb-72c1-4e7d-8f01-65eed26d5931 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: b402a148-2510-4b7a-99ff-71ac77e3854f] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:16.697189 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7f93e0bb-72c1-4e7d-8f01-65eed26d5931 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:16.698012 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7f93e0bb-72c1-4e7d-8f01-65eed26d5931 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:16.698801 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7f93e0bb-72c1-4e7d-8f01-65eed26d5931 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:16.699831 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7f93e0bb-72c1-4e7d-8f01-65eed26d5931 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:16.700609 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7f93e0bb-72c1-4e7d-8f01-65eed26d5931 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:16.701024 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7f93e0bb-72c1-4e7d-8f01-65eed26d5931 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:16.888983 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-79abb4ff-5858-4ee8-b2c2-74c55f144338 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:16.889630 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-79abb4ff-5858-4ee8-b2c2-74c55f144338 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:16.896793 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-79abb4ff-5858-4ee8-b2c2-74c55f144338 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:16.897436 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-79abb4ff-5858-4ee8-b2c2-74c55f144338 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:16.897873 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-79abb4ff-5858-4ee8-b2c2-74c55f144338 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:16.898665 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-79abb4ff-5858-4ee8-b2c2-74c55f144338 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:16.899540 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-79abb4ff-5858-4ee8-b2c2-74c55f144338 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:16.899954 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-79abb4ff-5858-4ee8-b2c2-74c55f144338 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:17.187437 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-7f93e0bb-72c1-4e7d-8f01-65eed26d5931 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:17.198133 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-7f93e0bb-72c1-4e7d-8f01-65eed26d5931 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/b402a148-2510-4b7a-99ff-71ac77e3854f" status: 200 len: 1266 microversion: 2.1 time: 0.515124 Sep 01 16:47:17.198725 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 511/994] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:16 2022] GET /compute/v2.1/servers/b402a148-2510-4b7a-99ff-71ac77e3854f => generated 1266 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:17.217052 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-79abb4ff-5858-4ee8-b2c2-74c55f144338 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd762a5837f034fc2aafa0efa33708530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b373831f3c5412eb2170fef6580c110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:17.226020 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-79abb4ff-5858-4ee8-b2c2-74c55f144338 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149" status: 200 len: 1358 microversion: 2.1 time: 0.341051 Sep 01 16:47:17.228765 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 484/995] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:16 2022] GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149 => generated 1358 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:17.394192 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-c76c0819-4058-4a59-a6a5-1d8a236ab477 req-e5b9c184-0f4c-4c09-8e94-17454411da30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb0c97da-94e3-4074-bc30-315c7bd7f149", "name": "network-vif-plugged", "status": "completed", "tag": "16e95cfd-eabb-4756-aff5-3331cb2f2007"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:47:17.412532 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-c76c0819-4058-4a59-a6a5-1d8a236ab477 req-e5b9c184-0f4c-4c09-8e94-17454411da30 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:17.413006 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-c76c0819-4058-4a59-a6a5-1d8a236ab477 req-e5b9c184-0f4c-4c09-8e94-17454411da30 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:17.413533 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-c76c0819-4058-4a59-a6a5-1d8a236ab477 req-e5b9c184-0f4c-4c09-8e94-17454411da30 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:17.428038 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-c76c0819-4058-4a59-a6a5-1d8a236ab477 req-e5b9c184-0f4c-4c09-8e94-17454411da30 service nova] Creating event network-vif-plugged:16e95cfd-eabb-4756-aff5-3331cb2f2007 for instance eb0c97da-94e3-4074-bc30-315c7bd7f149 on hv-cinder-85221 Sep 01 16:47:17.435224 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-c76c0819-4058-4a59-a6a5-1d8a236ab477 req-e5b9c184-0f4c-4c09-8e94-17454411da30 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142321 Sep 01 16:47:17.436158 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 512/996] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:47:17.569921 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-67821680-addc-4d02-abde-26d8aea897e6 req-360de1f9-4012-4b65-8fb6-946474cd4f6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b402a148-2510-4b7a-99ff-71ac77e3854f", "tag": "5a7b13db-900a-4234-bb03-06023d66c959"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:47:17.582273 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-67821680-addc-4d02-abde-26d8aea897e6 req-360de1f9-4012-4b65-8fb6-946474cd4f6b service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:17.583214 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-67821680-addc-4d02-abde-26d8aea897e6 req-360de1f9-4012-4b65-8fb6-946474cd4f6b service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:17.583655 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-67821680-addc-4d02-abde-26d8aea897e6 req-360de1f9-4012-4b65-8fb6-946474cd4f6b service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:17.599459 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-67821680-addc-4d02-abde-26d8aea897e6 req-360de1f9-4012-4b65-8fb6-946474cd4f6b service nova] Creating event network-changed:5a7b13db-900a-4234-bb03-06023d66c959 for instance b402a148-2510-4b7a-99ff-71ac77e3854f on hv-cinder-85221 Sep 01 16:47:17.605131 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-67821680-addc-4d02-abde-26d8aea897e6 req-360de1f9-4012-4b65-8fb6-946474cd4f6b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039520 Sep 01 16:47:17.606104 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 485/997] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:47:18.225658 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-15b9505c-c4b5-44e2-9da2-acc9bdb6addd tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:18.226436 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-15b9505c-c4b5-44e2-9da2-acc9bdb6addd tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: b402a148-2510-4b7a-99ff-71ac77e3854f] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:18.233137 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-15b9505c-c4b5-44e2-9da2-acc9bdb6addd tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:18.233627 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-15b9505c-c4b5-44e2-9da2-acc9bdb6addd tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:18.234024 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-15b9505c-c4b5-44e2-9da2-acc9bdb6addd tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:18.234726 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-15b9505c-c4b5-44e2-9da2-acc9bdb6addd tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:18.235170 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-15b9505c-c4b5-44e2-9da2-acc9bdb6addd tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:18.235582 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-15b9505c-c4b5-44e2-9da2-acc9bdb6addd tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:18.250050 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-df2c02d9-6380-4fee-8977-bae4f433fd52 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:18.251020 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-df2c02d9-6380-4fee-8977-bae4f433fd52 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:18.259535 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-df2c02d9-6380-4fee-8977-bae4f433fd52 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:18.260065 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-df2c02d9-6380-4fee-8977-bae4f433fd52 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:18.260504 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-df2c02d9-6380-4fee-8977-bae4f433fd52 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:18.261255 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-df2c02d9-6380-4fee-8977-bae4f433fd52 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:18.261748 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-df2c02d9-6380-4fee-8977-bae4f433fd52 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:18.262175 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-df2c02d9-6380-4fee-8977-bae4f433fd52 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:18.449903 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-15b9505c-c4b5-44e2-9da2-acc9bdb6addd tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:18.457812 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-df2c02d9-6380-4fee-8977-bae4f433fd52 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd762a5837f034fc2aafa0efa33708530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b373831f3c5412eb2170fef6580c110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:18.458479 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-15b9505c-c4b5-44e2-9da2-acc9bdb6addd tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/b402a148-2510-4b7a-99ff-71ac77e3854f" status: 200 len: 1266 microversion: 2.1 time: 0.237281 Sep 01 16:47:18.459087 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 513/998] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:18 2022] GET /compute/v2.1/servers/b402a148-2510-4b7a-99ff-71ac77e3854f => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:18.466130 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-df2c02d9-6380-4fee-8977-bae4f433fd52 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149" status: 200 len: 1358 microversion: 2.1 time: 0.220442 Sep 01 16:47:18.466733 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 486/999] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:18 2022] GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149 => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:19.479559 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b82384e8-e6d4-46c7-9708-2bf5dcdc5b9c tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:19.480204 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-b82384e8-e6d4-46c7-9708-2bf5dcdc5b9c tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: b402a148-2510-4b7a-99ff-71ac77e3854f] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:19.486437 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-930bcd23-7513-49ea-b0b0-e9a350614afc tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:19.486990 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b82384e8-e6d4-46c7-9708-2bf5dcdc5b9c tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:19.487138 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-930bcd23-7513-49ea-b0b0-e9a350614afc tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:19.487477 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b82384e8-e6d4-46c7-9708-2bf5dcdc5b9c tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:19.487918 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b82384e8-e6d4-46c7-9708-2bf5dcdc5b9c tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:19.488675 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b82384e8-e6d4-46c7-9708-2bf5dcdc5b9c tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:19.489530 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b82384e8-e6d4-46c7-9708-2bf5dcdc5b9c tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:19.489950 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b82384e8-e6d4-46c7-9708-2bf5dcdc5b9c tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:19.497791 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-930bcd23-7513-49ea-b0b0-e9a350614afc tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:19.498298 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-930bcd23-7513-49ea-b0b0-e9a350614afc tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:19.498733 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-930bcd23-7513-49ea-b0b0-e9a350614afc tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:19.499451 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-930bcd23-7513-49ea-b0b0-e9a350614afc tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:19.499933 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-930bcd23-7513-49ea-b0b0-e9a350614afc tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:19.500844 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-930bcd23-7513-49ea-b0b0-e9a350614afc tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:19.785733 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b82384e8-e6d4-46c7-9708-2bf5dcdc5b9c tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:19.795912 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-b82384e8-e6d4-46c7-9708-2bf5dcdc5b9c tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/b402a148-2510-4b7a-99ff-71ac77e3854f" status: 200 len: 1266 microversion: 2.1 time: 0.320297 Sep 01 16:47:19.801209 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 514/1000] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:19 2022] GET /compute/v2.1/servers/b402a148-2510-4b7a-99ff-71ac77e3854f => generated 1266 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:19.803108 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-930bcd23-7513-49ea-b0b0-e9a350614afc tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd762a5837f034fc2aafa0efa33708530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b373831f3c5412eb2170fef6580c110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:19.807181 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:19.814273 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-930bcd23-7513-49ea-b0b0-e9a350614afc tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149" status: 200 len: 1547 microversion: 2.1 time: 0.331530 Sep 01 16:47:19.815041 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 487/1001] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:19 2022] GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149 => generated 1547 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:19.843844 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-50d9b744-9690-4306-8f56-0d16e3f69683 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:19.844582 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-50d9b744-9690-4306-8f56-0d16e3f69683 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:19.851214 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-50d9b744-9690-4306-8f56-0d16e3f69683 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:19.851695 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-50d9b744-9690-4306-8f56-0d16e3f69683 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:19.852143 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-50d9b744-9690-4306-8f56-0d16e3f69683 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:19.852829 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-50d9b744-9690-4306-8f56-0d16e3f69683 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:19.853272 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-50d9b744-9690-4306-8f56-0d16e3f69683 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:19.853715 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-50d9b744-9690-4306-8f56-0d16e3f69683 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:20.088068 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-50d9b744-9690-4306-8f56-0d16e3f69683 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd762a5837f034fc2aafa0efa33708530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b373831f3c5412eb2170fef6580c110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:20.097320 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-50d9b744-9690-4306-8f56-0d16e3f69683 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149" status: 200 len: 1547 microversion: 2.1 time: 0.257357 Sep 01 16:47:20.097953 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 515/1002] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:19 2022] GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149 => generated 1547 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:20.118180 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-94e4f86f-30eb-4780-ae25-502b4d9143c0 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:20.123273 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-94e4f86f-30eb-4780-ae25-502b4d9143c0 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd762a5837f034fc2aafa0efa33708530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b373831f3c5412eb2170fef6580c110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:20.124213 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-94e4f86f-30eb-4780-ae25-502b4d9143c0 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Searching by: {'deleted': False, 'project_id': '3b373831f3c5412eb2170fef6580c110'} {{(pid=127198) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 16:47:20.132112 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-94e4f86f-30eb-4780-ae25-502b4d9143c0 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:20.132606 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-94e4f86f-30eb-4780-ae25-502b4d9143c0 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:20.133042 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-94e4f86f-30eb-4780-ae25-502b4d9143c0 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:20.133759 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-94e4f86f-30eb-4780-ae25-502b4d9143c0 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:20.134220 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-94e4f86f-30eb-4780-ae25-502b4d9143c0 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:20.134637 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-94e4f86f-30eb-4780-ae25-502b4d9143c0 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:20.228672 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.multi_cell_list [None req-94e4f86f-30eb-4780-ae25-502b4d9143c0 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127198) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 16:47:20.322665 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-94e4f86f-30eb-4780-ae25-502b4d9143c0 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.208359 Sep 01 16:47:20.323260 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 488/1003] 10.222.0.62 () {58 vars in 1125 bytes} [Thu Sep 1 16:47:20 2022] GET /compute/v2.1/servers => generated 343 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:47:20.334845 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-632283aa-fbd0-4a7c-b0f7-f312c42505e6 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:20.335517 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-632283aa-fbd0-4a7c-b0f7-f312c42505e6 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:20.342170 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-632283aa-fbd0-4a7c-b0f7-f312c42505e6 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:20.342654 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-632283aa-fbd0-4a7c-b0f7-f312c42505e6 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:20.343098 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-632283aa-fbd0-4a7c-b0f7-f312c42505e6 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:20.343787 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-632283aa-fbd0-4a7c-b0f7-f312c42505e6 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:20.344285 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-632283aa-fbd0-4a7c-b0f7-f312c42505e6 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:20.344699 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-632283aa-fbd0-4a7c-b0f7-f312c42505e6 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:20.481493 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-632283aa-fbd0-4a7c-b0f7-f312c42505e6 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd762a5837f034fc2aafa0efa33708530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b373831f3c5412eb2170fef6580c110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:20.490347 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-632283aa-fbd0-4a7c-b0f7-f312c42505e6 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149" status: 200 len: 1547 microversion: 2.1 time: 0.159577 Sep 01 16:47:20.490910 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 516/1004] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:20 2022] GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149 => generated 1547 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:20.826737 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-10778b45-e40a-4c51-b2e4-ff9ac8ded861 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:20.827465 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-10778b45-e40a-4c51-b2e4-ff9ac8ded861 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: b402a148-2510-4b7a-99ff-71ac77e3854f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:20.834087 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-10778b45-e40a-4c51-b2e4-ff9ac8ded861 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:20.834545 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-10778b45-e40a-4c51-b2e4-ff9ac8ded861 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:20.834978 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-10778b45-e40a-4c51-b2e4-ff9ac8ded861 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:20.835669 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-10778b45-e40a-4c51-b2e4-ff9ac8ded861 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:20.836148 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-10778b45-e40a-4c51-b2e4-ff9ac8ded861 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:20.836565 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-10778b45-e40a-4c51-b2e4-ff9ac8ded861 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:20.972943 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-10778b45-e40a-4c51-b2e4-ff9ac8ded861 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:20.981217 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-10778b45-e40a-4c51-b2e4-ff9ac8ded861 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/b402a148-2510-4b7a-99ff-71ac77e3854f" status: 200 len: 1266 microversion: 2.1 time: 0.158386 Sep 01 16:47:20.981784 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 489/1005] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:20 2022] GET /compute/v2.1/servers/b402a148-2510-4b7a-99ff-71ac77e3854f => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:22.001507 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-71014266-1774-4edf-ae8a-47bf059bc9de tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:22.002146 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-71014266-1774-4edf-ae8a-47bf059bc9de tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: b402a148-2510-4b7a-99ff-71ac77e3854f] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:22.008604 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-71014266-1774-4edf-ae8a-47bf059bc9de tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:22.009093 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-71014266-1774-4edf-ae8a-47bf059bc9de tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:22.009527 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-71014266-1774-4edf-ae8a-47bf059bc9de tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:22.010222 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-71014266-1774-4edf-ae8a-47bf059bc9de tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:22.010674 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-71014266-1774-4edf-ae8a-47bf059bc9de tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:22.011093 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-71014266-1774-4edf-ae8a-47bf059bc9de tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:22.015325 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=100 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:22.053092 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-bfd5cf73-5970-45ce-b815-a2cefdaaa282 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "983d21d3-2a13-4727-ad96-9450e1143a45"}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:47:22.055695 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-bfd5cf73-5970-45ce-b815-a2cefdaaa282 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:22.063832 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bfd5cf73-5970-45ce-b815-a2cefdaaa282 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:22.064358 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bfd5cf73-5970-45ce-b815-a2cefdaaa282 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:22.064801 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bfd5cf73-5970-45ce-b815-a2cefdaaa282 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:22.065520 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bfd5cf73-5970-45ce-b815-a2cefdaaa282 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:22.066118 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bfd5cf73-5970-45ce-b815-a2cefdaaa282 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:22.066839 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-bfd5cf73-5970-45ce-b815-a2cefdaaa282 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:22.187537 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-71014266-1774-4edf-ae8a-47bf059bc9de tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:22.201358 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-71014266-1774-4edf-ae8a-47bf059bc9de tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/b402a148-2510-4b7a-99ff-71ac77e3854f" status: 200 len: 1266 microversion: 2.1 time: 0.203524 Sep 01 16:47:22.202006 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 517/1006] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:21 2022] GET /compute/v2.1/servers/b402a148-2510-4b7a-99ff-71ac77e3854f => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:22.353373 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-bfd5cf73-5970-45ce-b815-a2cefdaaa282 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "POST /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304068 Sep 01 16:47:22.353896 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 490/1007] 10.222.0.62 () {60 vars in 1323 bytes} [Thu Sep 1 16:47:22 2022] POST /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:47:23.226999 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c712986c-e2ef-40f1-8a89-40f6f8275cfc tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:23.227642 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-c712986c-e2ef-40f1-8a89-40f6f8275cfc tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: b402a148-2510-4b7a-99ff-71ac77e3854f] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:23.237336 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c712986c-e2ef-40f1-8a89-40f6f8275cfc tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:23.237873 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c712986c-e2ef-40f1-8a89-40f6f8275cfc tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:23.239377 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c712986c-e2ef-40f1-8a89-40f6f8275cfc tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:23.240396 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c712986c-e2ef-40f1-8a89-40f6f8275cfc tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:23.241000 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c712986c-e2ef-40f1-8a89-40f6f8275cfc tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:23.241442 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c712986c-e2ef-40f1-8a89-40f6f8275cfc tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:23.350616 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-4c1a9b46-b89c-42db-a9f9-d02a3d25708b req-9004ea9d-2d53-4ae7-abaa-b868de6b8132 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b402a148-2510-4b7a-99ff-71ac77e3854f", "name": "network-vif-plugged", "status": "completed", "tag": "5a7b13db-900a-4234-bb03-06023d66c959"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:47:23.361618 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-4c1a9b46-b89c-42db-a9f9-d02a3d25708b req-9004ea9d-2d53-4ae7-abaa-b868de6b8132 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:23.362176 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-4c1a9b46-b89c-42db-a9f9-d02a3d25708b req-9004ea9d-2d53-4ae7-abaa-b868de6b8132 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:23.362922 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-4c1a9b46-b89c-42db-a9f9-d02a3d25708b req-9004ea9d-2d53-4ae7-abaa-b868de6b8132 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:23.375447 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-4c1a9b46-b89c-42db-a9f9-d02a3d25708b req-9004ea9d-2d53-4ae7-abaa-b868de6b8132 service nova] Creating event network-vif-plugged:5a7b13db-900a-4234-bb03-06023d66c959 for instance b402a148-2510-4b7a-99ff-71ac77e3854f on hv-cinder-85221 Sep 01 16:47:23.381556 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-4c1a9b46-b89c-42db-a9f9-d02a3d25708b req-9004ea9d-2d53-4ae7-abaa-b868de6b8132 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035027 Sep 01 16:47:23.382309 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 491/1008] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:47:23.461101 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c712986c-e2ef-40f1-8a89-40f6f8275cfc tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:23.470886 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-c712986c-e2ef-40f1-8a89-40f6f8275cfc tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/b402a148-2510-4b7a-99ff-71ac77e3854f" status: 200 len: 1266 microversion: 2.1 time: 0.249712 Sep 01 16:47:23.472418 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 518/1009] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:23 2022] GET /compute/v2.1/servers/b402a148-2510-4b7a-99ff-71ac77e3854f => generated 1266 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:24.495822 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-fd9de410-19ed-447b-9eda-3f6558692557 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:24.496536 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-fd9de410-19ed-447b-9eda-3f6558692557 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: b402a148-2510-4b7a-99ff-71ac77e3854f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:24.504594 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fd9de410-19ed-447b-9eda-3f6558692557 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:24.505092 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fd9de410-19ed-447b-9eda-3f6558692557 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:24.505545 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fd9de410-19ed-447b-9eda-3f6558692557 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:24.506244 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fd9de410-19ed-447b-9eda-3f6558692557 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:24.506753 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fd9de410-19ed-447b-9eda-3f6558692557 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:24.507146 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fd9de410-19ed-447b-9eda-3f6558692557 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:24.669903 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-fd9de410-19ed-447b-9eda-3f6558692557 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:24.678978 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-fd9de410-19ed-447b-9eda-3f6558692557 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/b402a148-2510-4b7a-99ff-71ac77e3854f" status: 200 len: 1266 microversion: 2.1 time: 0.187778 Sep 01 16:47:24.679613 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 492/1010] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:24 2022] GET /compute/v2.1/servers/b402a148-2510-4b7a-99ff-71ac77e3854f => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:25.702191 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-5ecd51ad-5f5d-47d6-b01f-a3541fcf35a9 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:25.702811 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-5ecd51ad-5f5d-47d6-b01f-a3541fcf35a9 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: b402a148-2510-4b7a-99ff-71ac77e3854f] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:25.704694 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=2 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:25.705908 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=8 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:25.712402 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5ecd51ad-5f5d-47d6-b01f-a3541fcf35a9 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:25.712933 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5ecd51ad-5f5d-47d6-b01f-a3541fcf35a9 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:25.713395 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5ecd51ad-5f5d-47d6-b01f-a3541fcf35a9 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:25.714104 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5ecd51ad-5f5d-47d6-b01f-a3541fcf35a9 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:25.714565 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5ecd51ad-5f5d-47d6-b01f-a3541fcf35a9 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:25.714987 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5ecd51ad-5f5d-47d6-b01f-a3541fcf35a9 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:25.949850 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-5ecd51ad-5f5d-47d6-b01f-a3541fcf35a9 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:25.958404 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-5ecd51ad-5f5d-47d6-b01f-a3541fcf35a9 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/b402a148-2510-4b7a-99ff-71ac77e3854f" status: 200 len: 1453 microversion: 2.1 time: 0.260204 Sep 01 16:47:25.958987 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 519/1011] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:25 2022] GET /compute/v2.1/servers/b402a148-2510-4b7a-99ff-71ac77e3854f => generated 1453 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:25.985439 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b2ea4bff-4dbd-4b40-b6bb-f97da72d7e63 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:25.986253 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b2ea4bff-4dbd-4b40-b6bb-f97da72d7e63 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: b402a148-2510-4b7a-99ff-71ac77e3854f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:25.993381 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b2ea4bff-4dbd-4b40-b6bb-f97da72d7e63 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:25.993886 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b2ea4bff-4dbd-4b40-b6bb-f97da72d7e63 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:25.994324 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b2ea4bff-4dbd-4b40-b6bb-f97da72d7e63 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:25.995035 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b2ea4bff-4dbd-4b40-b6bb-f97da72d7e63 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:25.995495 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b2ea4bff-4dbd-4b40-b6bb-f97da72d7e63 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:25.995921 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b2ea4bff-4dbd-4b40-b6bb-f97da72d7e63 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:26.209112 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b2ea4bff-4dbd-4b40-b6bb-f97da72d7e63 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:26.217087 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b2ea4bff-4dbd-4b40-b6bb-f97da72d7e63 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/b402a148-2510-4b7a-99ff-71ac77e3854f" status: 200 len: 1453 microversion: 2.1 time: 0.241391 Sep 01 16:47:26.217650 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 493/1012] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:25 2022] GET /compute/v2.1/servers/b402a148-2510-4b7a-99ff-71ac77e3854f => generated 1453 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:28.213662 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-a2ff98c1-4162-4644-9266-804e40411430 req-957ff4b7-2fab-4827-b8b8-00ee27275f49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b402a148-2510-4b7a-99ff-71ac77e3854f", "tag": "5a7b13db-900a-4234-bb03-06023d66c959"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:47:28.224730 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-a2ff98c1-4162-4644-9266-804e40411430 req-957ff4b7-2fab-4827-b8b8-00ee27275f49 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:28.225209 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-a2ff98c1-4162-4644-9266-804e40411430 req-957ff4b7-2fab-4827-b8b8-00ee27275f49 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:28.225633 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-a2ff98c1-4162-4644-9266-804e40411430 req-957ff4b7-2fab-4827-b8b8-00ee27275f49 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:28.238794 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-a2ff98c1-4162-4644-9266-804e40411430 req-957ff4b7-2fab-4827-b8b8-00ee27275f49 service nova] Creating event network-changed:5a7b13db-900a-4234-bb03-06023d66c959 for instance b402a148-2510-4b7a-99ff-71ac77e3854f on hv-cinder-85221 Sep 01 16:47:28.244510 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-a2ff98c1-4162-4644-9266-804e40411430 req-957ff4b7-2fab-4827-b8b8-00ee27275f49 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035151 Sep 01 16:47:28.245272 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 520/1013] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:47:28.987112 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-938d6fcf-7860-4aed-8d51-d8a264c04eca tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:28.987824 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-938d6fcf-7860-4aed-8d51-d8a264c04eca tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:28.995120 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:28.996363 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-938d6fcf-7860-4aed-8d51-d8a264c04eca tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:28.996858 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-938d6fcf-7860-4aed-8d51-d8a264c04eca tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:28.997295 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-938d6fcf-7860-4aed-8d51-d8a264c04eca tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:28.998017 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-938d6fcf-7860-4aed-8d51-d8a264c04eca tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:28.998659 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-938d6fcf-7860-4aed-8d51-d8a264c04eca tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:28.999088 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-938d6fcf-7860-4aed-8d51-d8a264c04eca tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:29.172869 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-938d6fcf-7860-4aed-8d51-d8a264c04eca tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd762a5837f034fc2aafa0efa33708530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b373831f3c5412eb2170fef6580c110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:29.182157 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-938d6fcf-7860-4aed-8d51-d8a264c04eca tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149" status: 200 len: 1593 microversion: 2.1 time: 0.198854 Sep 01 16:47:29.182757 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 494/1014] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:28 2022] GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149 => generated 1593 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:31.252300 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-d5ad3769-648f-46b5-a7a7-d18b91b3325e req-f437f2f8-b056-4e81-9900-4fe9829d5fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb0c97da-94e3-4074-bc30-315c7bd7f149", "tag": "16e95cfd-eabb-4756-aff5-3331cb2f2007"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:47:31.259266 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=6 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:31.264537 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-d5ad3769-648f-46b5-a7a7-d18b91b3325e req-f437f2f8-b056-4e81-9900-4fe9829d5fd8 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:31.265024 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-d5ad3769-648f-46b5-a7a7-d18b91b3325e req-f437f2f8-b056-4e81-9900-4fe9829d5fd8 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:31.265507 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-d5ad3769-648f-46b5-a7a7-d18b91b3325e req-f437f2f8-b056-4e81-9900-4fe9829d5fd8 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:31.279020 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-d5ad3769-648f-46b5-a7a7-d18b91b3325e req-f437f2f8-b056-4e81-9900-4fe9829d5fd8 service nova] Creating event network-changed:16e95cfd-eabb-4756-aff5-3331cb2f2007 for instance eb0c97da-94e3-4074-bc30-315c7bd7f149 on hv-cinder-85221 Sep 01 16:47:31.287235 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-d5ad3769-648f-46b5-a7a7-d18b91b3325e req-f437f2f8-b056-4e81-9900-4fe9829d5fd8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105171 Sep 01 16:47:31.287235 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 521/1015] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:47:32.532217 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9f345533-5a55-4294-9964-00d4183cc53b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-575847025"}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:47:32.532781 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-9f345533-5a55-4294-9964-00d4183cc53b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:32.535228 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:32.540832 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9f345533-5a55-4294-9964-00d4183cc53b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:32.541326 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9f345533-5a55-4294-9964-00d4183cc53b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:32.541785 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9f345533-5a55-4294-9964-00d4183cc53b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:32.542480 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9f345533-5a55-4294-9964-00d4183cc53b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:32.542909 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9f345533-5a55-4294-9964-00d4183cc53b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:32.543328 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-9f345533-5a55-4294-9964-00d4183cc53b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:32.683580 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.network.security_group_api [None req-9f345533-5a55-4294-9964-00d4183cc53b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Adding security group c55a65a1-87ad-4529-a4fc-031d258258e6 to port 16e95cfd-eabb-4756-aff5-3331cb2f2007 Sep 01 16:47:33.031549 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9f345533-5a55-4294-9964-00d4183cc53b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "POST /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149/action" status: 202 len: 0 microversion: 2.1 time: 0.503261 Sep 01 16:47:33.036104 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 495/1016] 10.222.0.62 () {60 vars in 1278 bytes} [Thu Sep 1 16:47:32 2022] POST /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149/action => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 16:47:33.042920 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c01193ff-17d7-4bf0-9a5b-757bbdcdd7f4 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:33.043700 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-c01193ff-17d7-4bf0-9a5b-757bbdcdd7f4 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:33.053935 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [req-0dedefca-b12b-4dd8-9c8d-8cf54d02177b req-3c5cae50-2d6f-40bc-b3a4-e6ee7a04be3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb0c97da-94e3-4074-bc30-315c7bd7f149", "tag": "16e95cfd-eabb-4756-aff5-3331cb2f2007"}]} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:47:33.057051 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c01193ff-17d7-4bf0-9a5b-757bbdcdd7f4 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:33.058530 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c01193ff-17d7-4bf0-9a5b-757bbdcdd7f4 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:33.059090 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c01193ff-17d7-4bf0-9a5b-757bbdcdd7f4 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:33.061301 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c01193ff-17d7-4bf0-9a5b-757bbdcdd7f4 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:33.061854 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c01193ff-17d7-4bf0-9a5b-757bbdcdd7f4 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:33.063569 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c01193ff-17d7-4bf0-9a5b-757bbdcdd7f4 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:33.077175 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-0dedefca-b12b-4dd8-9c8d-8cf54d02177b req-3c5cae50-2d6f-40bc-b3a4-e6ee7a04be3d service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:33.077969 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-0dedefca-b12b-4dd8-9c8d-8cf54d02177b req-3c5cae50-2d6f-40bc-b3a4-e6ee7a04be3d service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:33.078564 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [req-0dedefca-b12b-4dd8-9c8d-8cf54d02177b req-3c5cae50-2d6f-40bc-b3a4-e6ee7a04be3d service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:33.090854 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.compute.server_external_events [req-0dedefca-b12b-4dd8-9c8d-8cf54d02177b req-3c5cae50-2d6f-40bc-b3a4-e6ee7a04be3d service nova] Creating event network-changed:16e95cfd-eabb-4756-aff5-3331cb2f2007 for instance eb0c97da-94e3-4074-bc30-315c7bd7f149 on hv-cinder-85221 Sep 01 16:47:33.097523 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [req-0dedefca-b12b-4dd8-9c8d-8cf54d02177b req-3c5cae50-2d6f-40bc-b3a4-e6ee7a04be3d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049309 Sep 01 16:47:33.099243 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 496/1017] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:47:33.359871 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c01193ff-17d7-4bf0-9a5b-757bbdcdd7f4 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd762a5837f034fc2aafa0efa33708530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b373831f3c5412eb2170fef6580c110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:33.369160 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-c01193ff-17d7-4bf0-9a5b-757bbdcdd7f4 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149" status: 200 len: 1758 microversion: 2.1 time: 0.331101 Sep 01 16:47:33.369810 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 522/1018] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:33 2022] GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149 => generated 1758 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:55.696132 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-cae56028-4f7d-41d5-973c-44bcc988a01b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:47:55.698870 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-cae56028-4f7d-41d5-973c-44bcc988a01b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:55.701648 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=5 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:55.702306 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:55.710020 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cae56028-4f7d-41d5-973c-44bcc988a01b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:55.710513 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cae56028-4f7d-41d5-973c-44bcc988a01b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:55.711029 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cae56028-4f7d-41d5-973c-44bcc988a01b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:55.712071 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cae56028-4f7d-41d5-973c-44bcc988a01b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:55.712533 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cae56028-4f7d-41d5-973c-44bcc988a01b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:55.712956 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cae56028-4f7d-41d5-973c-44bcc988a01b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:55.813837 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-cae56028-4f7d-41d5-973c-44bcc988a01b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "POST /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149/action" status: 202 len: 0 microversion: 2.1 time: 0.121876 Sep 01 16:47:55.814920 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 497/1019] 10.222.0.62 () {60 vars in 1278 bytes} [Thu Sep 1 16:47:55 2022] POST /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:47:55.834414 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-16412295-b8f2-42d4-9a2d-d637bc90a420 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:55.835166 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-16412295-b8f2-42d4-9a2d-d637bc90a420 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:55.838537 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=3 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:55.839260 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=26 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:55.846092 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-16412295-b8f2-42d4-9a2d-d637bc90a420 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:55.846589 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-16412295-b8f2-42d4-9a2d-d637bc90a420 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:55.847022 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-16412295-b8f2-42d4-9a2d-d637bc90a420 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:55.847733 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-16412295-b8f2-42d4-9a2d-d637bc90a420 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:55.848212 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-16412295-b8f2-42d4-9a2d-d637bc90a420 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:55.848633 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-16412295-b8f2-42d4-9a2d-d637bc90a420 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:56.113024 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-16412295-b8f2-42d4-9a2d-d637bc90a420 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd762a5837f034fc2aafa0efa33708530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b373831f3c5412eb2170fef6580c110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:56.121882 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-16412295-b8f2-42d4-9a2d-d637bc90a420 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149" status: 200 len: 1750 microversion: 2.1 time: 0.297795 Sep 01 16:47:56.122462 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 523/1020] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:55 2022] GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149 => generated 1750 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:57.154887 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1cc183b3-5f67-4460-b83a-09997905ed6a tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:57.155554 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1cc183b3-5f67-4460-b83a-09997905ed6a tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:57.162644 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1cc183b3-5f67-4460-b83a-09997905ed6a tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:57.163162 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1cc183b3-5f67-4460-b83a-09997905ed6a tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:57.163643 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1cc183b3-5f67-4460-b83a-09997905ed6a tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:57.164416 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1cc183b3-5f67-4460-b83a-09997905ed6a tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:57.164865 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1cc183b3-5f67-4460-b83a-09997905ed6a tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:57.165390 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-1cc183b3-5f67-4460-b83a-09997905ed6a tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:57.328428 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1cc183b3-5f67-4460-b83a-09997905ed6a tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd762a5837f034fc2aafa0efa33708530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b373831f3c5412eb2170fef6580c110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:57.337018 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1cc183b3-5f67-4460-b83a-09997905ed6a tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149" status: 200 len: 1755 microversion: 2.1 time: 0.187057 Sep 01 16:47:57.337599 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 498/1021] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:57 2022] GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149 => generated 1755 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:58.360057 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-843fc6af-29a0-46c0-95a1-d22f6a7d87ae tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:58.360679 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-843fc6af-29a0-46c0-95a1-d22f6a7d87ae tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:58.367662 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-843fc6af-29a0-46c0-95a1-d22f6a7d87ae tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:58.368182 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-843fc6af-29a0-46c0-95a1-d22f6a7d87ae tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:58.368617 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-843fc6af-29a0-46c0-95a1-d22f6a7d87ae tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:58.369318 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-843fc6af-29a0-46c0-95a1-d22f6a7d87ae tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:58.369769 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-843fc6af-29a0-46c0-95a1-d22f6a7d87ae tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:58.370193 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-843fc6af-29a0-46c0-95a1-d22f6a7d87ae tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:58.527904 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-843fc6af-29a0-46c0-95a1-d22f6a7d87ae tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd762a5837f034fc2aafa0efa33708530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b373831f3c5412eb2170fef6580c110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:58.536870 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-843fc6af-29a0-46c0-95a1-d22f6a7d87ae tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149" status: 200 len: 1755 microversion: 2.1 time: 0.181261 Sep 01 16:47:58.537428 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 524/1022] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:58 2022] GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149 => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:59.558732 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f6b04913-da93-497a-a823-9d9fafbc95d6 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:59.559303 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f6b04913-da93-497a-a823-9d9fafbc95d6 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:59.568448 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f6b04913-da93-497a-a823-9d9fafbc95d6 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:59.569376 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f6b04913-da93-497a-a823-9d9fafbc95d6 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:59.569953 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f6b04913-da93-497a-a823-9d9fafbc95d6 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:59.571345 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f6b04913-da93-497a-a823-9d9fafbc95d6 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:59.571877 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f6b04913-da93-497a-a823-9d9fafbc95d6 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:59.572419 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f6b04913-da93-497a-a823-9d9fafbc95d6 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:59.739597 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-f6b04913-da93-497a-a823-9d9fafbc95d6 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd762a5837f034fc2aafa0efa33708530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b373831f3c5412eb2170fef6580c110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:59.748290 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f6b04913-da93-497a-a823-9d9fafbc95d6 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149" status: 200 len: 1755 microversion: 2.1 time: 0.194498 Sep 01 16:47:59.748831 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 499/1023] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:59 2022] GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149 => generated 1755 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:00.770798 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-2ebbe66b-68ca-4813-a07a-999f04306991 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:00.771412 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-2ebbe66b-68ca-4813-a07a-999f04306991 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:00.778830 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2ebbe66b-68ca-4813-a07a-999f04306991 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:00.779339 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2ebbe66b-68ca-4813-a07a-999f04306991 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:00.779754 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2ebbe66b-68ca-4813-a07a-999f04306991 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:00.780525 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2ebbe66b-68ca-4813-a07a-999f04306991 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:00.780973 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2ebbe66b-68ca-4813-a07a-999f04306991 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:00.781453 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2ebbe66b-68ca-4813-a07a-999f04306991 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:00.933486 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-2ebbe66b-68ca-4813-a07a-999f04306991 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd762a5837f034fc2aafa0efa33708530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b373831f3c5412eb2170fef6580c110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:00.942932 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-2ebbe66b-68ca-4813-a07a-999f04306991 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149" status: 200 len: 1755 microversion: 2.1 time: 0.176007 Sep 01 16:48:00.943516 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 525/1024] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:00 2022] GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149 => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:01.964998 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-da37a01b-119a-41fd-acb9-f81516cf1ff2 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:01.965724 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-da37a01b-119a-41fd-acb9-f81516cf1ff2 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:01.972261 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-da37a01b-119a-41fd-acb9-f81516cf1ff2 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:01.972747 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-da37a01b-119a-41fd-acb9-f81516cf1ff2 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:01.973176 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-da37a01b-119a-41fd-acb9-f81516cf1ff2 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:01.973861 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-da37a01b-119a-41fd-acb9-f81516cf1ff2 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:01.974310 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-da37a01b-119a-41fd-acb9-f81516cf1ff2 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:01.974728 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-da37a01b-119a-41fd-acb9-f81516cf1ff2 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:02.156609 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-da37a01b-119a-41fd-acb9-f81516cf1ff2 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd762a5837f034fc2aafa0efa33708530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b373831f3c5412eb2170fef6580c110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:02.165230 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-da37a01b-119a-41fd-acb9-f81516cf1ff2 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149" status: 200 len: 1755 microversion: 2.1 time: 0.204436 Sep 01 16:48:02.165790 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 500/1025] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:01 2022] GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149 => generated 1755 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:03.191114 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-fcd9d42b-be90-4de3-b077-e2f6c08edf2b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:03.192145 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-fcd9d42b-be90-4de3-b077-e2f6c08edf2b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:03.203017 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fcd9d42b-be90-4de3-b077-e2f6c08edf2b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:03.203798 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fcd9d42b-be90-4de3-b077-e2f6c08edf2b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:03.204511 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fcd9d42b-be90-4de3-b077-e2f6c08edf2b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:03.205690 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fcd9d42b-be90-4de3-b077-e2f6c08edf2b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:03.206410 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fcd9d42b-be90-4de3-b077-e2f6c08edf2b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:03.207085 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fcd9d42b-be90-4de3-b077-e2f6c08edf2b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:03.475099 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-fcd9d42b-be90-4de3-b077-e2f6c08edf2b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd762a5837f034fc2aafa0efa33708530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b373831f3c5412eb2170fef6580c110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:03.493673 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-fcd9d42b-be90-4de3-b077-e2f6c08edf2b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149" status: 200 len: 1755 microversion: 2.1 time: 0.308897 Sep 01 16:48:03.494657 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 526/1026] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:03 2022] GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149 => generated 1755 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:04.526266 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7eda62d6-ca08-46e2-8ad7-75c416941bfc tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:04.526883 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7eda62d6-ca08-46e2-8ad7-75c416941bfc tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:04.533961 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7eda62d6-ca08-46e2-8ad7-75c416941bfc tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:04.534448 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7eda62d6-ca08-46e2-8ad7-75c416941bfc tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:04.534885 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7eda62d6-ca08-46e2-8ad7-75c416941bfc tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:04.535581 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7eda62d6-ca08-46e2-8ad7-75c416941bfc tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:04.536090 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7eda62d6-ca08-46e2-8ad7-75c416941bfc tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:04.536506 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7eda62d6-ca08-46e2-8ad7-75c416941bfc tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:04.713900 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7eda62d6-ca08-46e2-8ad7-75c416941bfc tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd762a5837f034fc2aafa0efa33708530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b373831f3c5412eb2170fef6580c110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:04.723200 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7eda62d6-ca08-46e2-8ad7-75c416941bfc tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149" status: 200 len: 1755 microversion: 2.1 time: 0.201238 Sep 01 16:48:04.723759 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 501/1027] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:04 2022] GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149 => generated 1755 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:05.747649 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d07525ba-1fa5-4ed9-b501-56996e1f10ac tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:05.748401 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d07525ba-1fa5-4ed9-b501-56996e1f10ac tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:05.765720 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d07525ba-1fa5-4ed9-b501-56996e1f10ac tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:05.766516 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d07525ba-1fa5-4ed9-b501-56996e1f10ac tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:05.766688 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d07525ba-1fa5-4ed9-b501-56996e1f10ac tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:05.768066 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d07525ba-1fa5-4ed9-b501-56996e1f10ac tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:05.768066 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d07525ba-1fa5-4ed9-b501-56996e1f10ac tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:05.768609 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d07525ba-1fa5-4ed9-b501-56996e1f10ac tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:05.933548 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d07525ba-1fa5-4ed9-b501-56996e1f10ac tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd762a5837f034fc2aafa0efa33708530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b373831f3c5412eb2170fef6580c110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:05.942311 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d07525ba-1fa5-4ed9-b501-56996e1f10ac tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149" status: 200 len: 1755 microversion: 2.1 time: 0.198746 Sep 01 16:48:05.942896 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 527/1028] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:05 2022] GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149 => generated 1755 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:06.966164 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-74d0034b-8391-4abe-85eb-a173fbc54e8b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:06.966775 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-74d0034b-8391-4abe-85eb-a173fbc54e8b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:06.973575 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-74d0034b-8391-4abe-85eb-a173fbc54e8b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:06.974072 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-74d0034b-8391-4abe-85eb-a173fbc54e8b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:06.974516 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-74d0034b-8391-4abe-85eb-a173fbc54e8b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:06.975214 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-74d0034b-8391-4abe-85eb-a173fbc54e8b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:06.975672 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-74d0034b-8391-4abe-85eb-a173fbc54e8b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:06.976125 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-74d0034b-8391-4abe-85eb-a173fbc54e8b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:07.158160 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-74d0034b-8391-4abe-85eb-a173fbc54e8b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd762a5837f034fc2aafa0efa33708530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b373831f3c5412eb2170fef6580c110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:07.167079 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-74d0034b-8391-4abe-85eb-a173fbc54e8b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149" status: 200 len: 1755 microversion: 2.1 time: 0.207208 Sep 01 16:48:07.167654 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 502/1029] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:06 2022] GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149 => generated 1755 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:08.189002 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-25467eb2-11a4-419b-a50d-3f22fbaa7e41 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:08.189617 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-25467eb2-11a4-419b-a50d-3f22fbaa7e41 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:08.197133 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-25467eb2-11a4-419b-a50d-3f22fbaa7e41 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:08.197625 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-25467eb2-11a4-419b-a50d-3f22fbaa7e41 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:08.198058 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-25467eb2-11a4-419b-a50d-3f22fbaa7e41 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:08.198762 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-25467eb2-11a4-419b-a50d-3f22fbaa7e41 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:08.199221 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-25467eb2-11a4-419b-a50d-3f22fbaa7e41 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:08.199645 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-25467eb2-11a4-419b-a50d-3f22fbaa7e41 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:08.346887 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-25467eb2-11a4-419b-a50d-3f22fbaa7e41 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd762a5837f034fc2aafa0efa33708530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b373831f3c5412eb2170fef6580c110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:08.357672 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-25467eb2-11a4-419b-a50d-3f22fbaa7e41 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149" status: 200 len: 1755 microversion: 2.1 time: 0.172518 Sep 01 16:48:08.358267 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 528/1030] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:08 2022] GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149 => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:09.381157 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d374902a-8d3d-40ec-88c1-9fb74923fe70 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:09.381730 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d374902a-8d3d-40ec-88c1-9fb74923fe70 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:09.388976 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d374902a-8d3d-40ec-88c1-9fb74923fe70 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:09.389657 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d374902a-8d3d-40ec-88c1-9fb74923fe70 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:09.390465 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d374902a-8d3d-40ec-88c1-9fb74923fe70 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:09.391158 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d374902a-8d3d-40ec-88c1-9fb74923fe70 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:09.391613 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d374902a-8d3d-40ec-88c1-9fb74923fe70 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:09.392067 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d374902a-8d3d-40ec-88c1-9fb74923fe70 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:09.542702 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d374902a-8d3d-40ec-88c1-9fb74923fe70 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd762a5837f034fc2aafa0efa33708530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b373831f3c5412eb2170fef6580c110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:09.555519 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d374902a-8d3d-40ec-88c1-9fb74923fe70 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149" status: 200 len: 1755 microversion: 2.1 time: 0.178799 Sep 01 16:48:09.556155 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 503/1031] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:09 2022] GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149 => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:10.578918 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-4f436a39-cdc4-4adc-9f79-1180e204b7c9 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:10.579547 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-4f436a39-cdc4-4adc-9f79-1180e204b7c9 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:10.587804 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4f436a39-cdc4-4adc-9f79-1180e204b7c9 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:10.588355 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4f436a39-cdc4-4adc-9f79-1180e204b7c9 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:10.588787 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4f436a39-cdc4-4adc-9f79-1180e204b7c9 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:10.589486 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4f436a39-cdc4-4adc-9f79-1180e204b7c9 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:10.589934 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4f436a39-cdc4-4adc-9f79-1180e204b7c9 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:10.590359 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4f436a39-cdc4-4adc-9f79-1180e204b7c9 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:10.777753 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-4f436a39-cdc4-4adc-9f79-1180e204b7c9 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd762a5837f034fc2aafa0efa33708530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b373831f3c5412eb2170fef6580c110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:10.788503 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-4f436a39-cdc4-4adc-9f79-1180e204b7c9 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149" status: 200 len: 1755 microversion: 2.1 time: 0.213371 Sep 01 16:48:10.789603 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 529/1032] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:10 2022] GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149 => generated 1755 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:11.816580 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0b2f0d91-43f8-4334-a983-1b62b36a1cca tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:11.817204 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0b2f0d91-43f8-4334-a983-1b62b36a1cca tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:11.829739 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0b2f0d91-43f8-4334-a983-1b62b36a1cca tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:11.829739 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0b2f0d91-43f8-4334-a983-1b62b36a1cca tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:11.829739 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0b2f0d91-43f8-4334-a983-1b62b36a1cca tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:11.829739 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0b2f0d91-43f8-4334-a983-1b62b36a1cca tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:11.830250 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0b2f0d91-43f8-4334-a983-1b62b36a1cca tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:11.830250 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0b2f0d91-43f8-4334-a983-1b62b36a1cca tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:11.997099 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-0b2f0d91-43f8-4334-a983-1b62b36a1cca tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd762a5837f034fc2aafa0efa33708530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b373831f3c5412eb2170fef6580c110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:12.005924 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0b2f0d91-43f8-4334-a983-1b62b36a1cca tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149" status: 200 len: 1755 microversion: 2.1 time: 0.194343 Sep 01 16:48:12.006530 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 504/1033] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:11 2022] GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149 => generated 1755 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:13.030456 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-588b2bb8-e2fd-438e-b7e3-dcb63b634ac9 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:13.031051 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-588b2bb8-e2fd-438e-b7e3-dcb63b634ac9 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:13.037844 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-588b2bb8-e2fd-438e-b7e3-dcb63b634ac9 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:13.038326 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-588b2bb8-e2fd-438e-b7e3-dcb63b634ac9 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:13.038748 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-588b2bb8-e2fd-438e-b7e3-dcb63b634ac9 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:13.039440 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-588b2bb8-e2fd-438e-b7e3-dcb63b634ac9 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:13.039918 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-588b2bb8-e2fd-438e-b7e3-dcb63b634ac9 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:13.040397 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-588b2bb8-e2fd-438e-b7e3-dcb63b634ac9 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:13.198415 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-588b2bb8-e2fd-438e-b7e3-dcb63b634ac9 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd762a5837f034fc2aafa0efa33708530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b373831f3c5412eb2170fef6580c110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:13.207655 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-588b2bb8-e2fd-438e-b7e3-dcb63b634ac9 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149" status: 200 len: 1758 microversion: 2.1 time: 0.181127 Sep 01 16:48:13.208295 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 530/1034] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:13 2022] GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149 => generated 1758 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:45.944312 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-cc5a0e6e-9bba-49d3-90ad-e538bfcec18c tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-575847025"}} {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:48:45.945862 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-cc5a0e6e-9bba-49d3-90ad-e538bfcec18c tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:45.948336 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=16 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:45.949030 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:45.957166 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cc5a0e6e-9bba-49d3-90ad-e538bfcec18c tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:45.958051 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cc5a0e6e-9bba-49d3-90ad-e538bfcec18c tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:45.958858 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cc5a0e6e-9bba-49d3-90ad-e538bfcec18c tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:45.960222 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cc5a0e6e-9bba-49d3-90ad-e538bfcec18c tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:45.961074 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cc5a0e6e-9bba-49d3-90ad-e538bfcec18c tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:45.961922 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-cc5a0e6e-9bba-49d3-90ad-e538bfcec18c tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:46.152022 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.network.security_group_api [None req-cc5a0e6e-9bba-49d3-90ad-e538bfcec18c tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Removing security group c55a65a1-87ad-4529-a4fc-031d258258e6 from port 16e95cfd-eabb-4756-aff5-3331cb2f2007 Sep 01 16:48:47.021786 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-cc5a0e6e-9bba-49d3-90ad-e538bfcec18c tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "POST /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149/action" status: 202 len: 0 microversion: 2.1 time: 1.084762 Sep 01 16:48:47.027658 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=16 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:47.028888 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=48 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:47.030726 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 505/1035] 10.222.0.62 () {60 vars in 1278 bytes} [Thu Sep 1 16:48:45 2022] POST /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149/action => generated 0 bytes in 1095 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:48:47.158405 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-600b56a7-f479-4d57-ae95-7d08b3180cba req-2284857b-7fb0-4df8-a62f-857e6a909348 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb0c97da-94e3-4074-bc30-315c7bd7f149", "tag": "16e95cfd-eabb-4756-aff5-3331cb2f2007"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:48:47.176917 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-600b56a7-f479-4d57-ae95-7d08b3180cba req-2284857b-7fb0-4df8-a62f-857e6a909348 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:47.178249 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-600b56a7-f479-4d57-ae95-7d08b3180cba req-2284857b-7fb0-4df8-a62f-857e6a909348 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:47.179134 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-600b56a7-f479-4d57-ae95-7d08b3180cba req-2284857b-7fb0-4df8-a62f-857e6a909348 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:47.202439 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-600b56a7-f479-4d57-ae95-7d08b3180cba req-2284857b-7fb0-4df8-a62f-857e6a909348 service nova] Creating event network-changed:16e95cfd-eabb-4756-aff5-3331cb2f2007 for instance eb0c97da-94e3-4074-bc30-315c7bd7f149 on hv-cinder-85221 Sep 01 16:48:47.217443 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-600b56a7-f479-4d57-ae95-7d08b3180cba req-2284857b-7fb0-4df8-a62f-857e6a909348 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191344 Sep 01 16:48:47.218520 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 531/1036] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:48:48.612146 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a8726aaf-f0f0-48d0-847b-b3062bef6780 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:48.614231 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a8726aaf-f0f0-48d0-847b-b3062bef6780 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:48.614563 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-b66987d8-4a65-4cac-b546-3e4b8282f403 req-63385253-78b3-493c-bca8-0cb6f4312c30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb0c97da-94e3-4074-bc30-315c7bd7f149", "tag": "16e95cfd-eabb-4756-aff5-3331cb2f2007"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:48:48.633757 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-b66987d8-4a65-4cac-b546-3e4b8282f403 req-63385253-78b3-493c-bca8-0cb6f4312c30 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:48.633757 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-b66987d8-4a65-4cac-b546-3e4b8282f403 req-63385253-78b3-493c-bca8-0cb6f4312c30 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:48.634869 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-b66987d8-4a65-4cac-b546-3e4b8282f403 req-63385253-78b3-493c-bca8-0cb6f4312c30 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:48.641092 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a8726aaf-f0f0-48d0-847b-b3062bef6780 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:48.642136 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a8726aaf-f0f0-48d0-847b-b3062bef6780 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:48.642588 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a8726aaf-f0f0-48d0-847b-b3062bef6780 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:48.643834 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a8726aaf-f0f0-48d0-847b-b3062bef6780 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:48.644694 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a8726aaf-f0f0-48d0-847b-b3062bef6780 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:48.645459 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a8726aaf-f0f0-48d0-847b-b3062bef6780 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:48.658143 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-b66987d8-4a65-4cac-b546-3e4b8282f403 req-63385253-78b3-493c-bca8-0cb6f4312c30 service nova] Creating event network-changed:16e95cfd-eabb-4756-aff5-3331cb2f2007 for instance eb0c97da-94e3-4074-bc30-315c7bd7f149 on hv-cinder-85221 Sep 01 16:48:48.669291 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-b66987d8-4a65-4cac-b546-3e4b8282f403 req-63385253-78b3-493c-bca8-0cb6f4312c30 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063382 Sep 01 16:48:48.670783 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 532/1037] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:48:48.810298 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-a8726aaf-f0f0-48d0-847b-b3062bef6780 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lazy-loading 'services' on Instance uuid eb0c97da-94e3-4074-bc30-315c7bd7f149 {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:48:48.930953 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a8726aaf-f0f0-48d0-847b-b3062bef6780 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "DELETE /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149/os-volume_attachments/983d21d3-2a13-4727-ad96-9450e1143a45" status: 202 len: 0 microversion: 2.1 time: 0.325845 Sep 01 16:48:48.932034 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 506/1038] 10.222.0.62 () {58 vars in 1416 bytes} [Thu Sep 1 16:48:48 2022] DELETE /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149/os-volume_attachments/983d21d3-2a13-4727-ad96-9450e1143a45 => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 16:48:48.951424 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-180a67a0-84be-4144-a121-b0f49f8e5d7d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:48.956273 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-180a67a0-84be-4144-a121-b0f49f8e5d7d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:48.972362 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-180a67a0-84be-4144-a121-b0f49f8e5d7d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:48.973197 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-180a67a0-84be-4144-a121-b0f49f8e5d7d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:48.974339 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-180a67a0-84be-4144-a121-b0f49f8e5d7d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:48.975953 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-180a67a0-84be-4144-a121-b0f49f8e5d7d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:48.977141 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-180a67a0-84be-4144-a121-b0f49f8e5d7d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:48.978189 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-180a67a0-84be-4144-a121-b0f49f8e5d7d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:49.026167 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-180a67a0-84be-4144-a121-b0f49f8e5d7d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083378 Sep 01 16:48:49.026167 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 533/1039] 10.222.0.62 () {58 vars in 1302 bytes} [Thu Sep 1 16:48:48 2022] GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:48:50.043536 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f52b480c-d4c3-4488-80b8-44254831a253 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:50.046057 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f52b480c-d4c3-4488-80b8-44254831a253 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:50.053303 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f52b480c-d4c3-4488-80b8-44254831a253 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:50.053779 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f52b480c-d4c3-4488-80b8-44254831a253 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:50.054207 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f52b480c-d4c3-4488-80b8-44254831a253 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:50.054917 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f52b480c-d4c3-4488-80b8-44254831a253 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:50.055371 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f52b480c-d4c3-4488-80b8-44254831a253 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:50.055782 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f52b480c-d4c3-4488-80b8-44254831a253 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:50.109685 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f52b480c-d4c3-4488-80b8-44254831a253 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071541 Sep 01 16:48:50.110475 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 507/1040] 10.222.0.62 () {58 vars in 1302 bytes} [Thu Sep 1 16:48:50 2022] GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 16:48:50.126969 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-fbd174bd-7d6b-42b3-85e8-434ffdaac94b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:50.127702 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-fbd174bd-7d6b-42b3-85e8-434ffdaac94b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:50.138527 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fbd174bd-7d6b-42b3-85e8-434ffdaac94b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:50.139392 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fbd174bd-7d6b-42b3-85e8-434ffdaac94b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:50.140500 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fbd174bd-7d6b-42b3-85e8-434ffdaac94b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:50.141358 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fbd174bd-7d6b-42b3-85e8-434ffdaac94b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:50.142108 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fbd174bd-7d6b-42b3-85e8-434ffdaac94b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:50.142842 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fbd174bd-7d6b-42b3-85e8-434ffdaac94b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:50.275936 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-fbd174bd-7d6b-42b3-85e8-434ffdaac94b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] HTTP exception thrown: Instance eb0c97da-94e3-4074-bc30-315c7bd7f149 is not attached to volume 983d21d3-2a13-4727-ad96-9450e1143a45 Sep 01 16:48:50.280768 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-fbd174bd-7d6b-42b3-85e8-434ffdaac94b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Request method failure captured: Sep 01 16:48:50.280768 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: request: DELETE /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149/os-volume_attachments/983d21d3-2a13-4727-ad96-9450e1143a45 HTTP/1.1 Sep 01 16:48:50.280768 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 01 16:48:50.280768 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 01 16:48:50.280768 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Connection: close Sep 01 16:48:50.280768 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 01 16:48:50.280768 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 01 16:48:50.280768 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Host: 10.222.0.62 Sep 01 16:48:50.280768 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 01 16:48:50.280768 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 01 16:48:50.280768 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjEOHwNmm1j7zUCLplLORBMa90aHQL4rCvMWZPW1s7CCFrx6Nj7Wd7oWmbfXdkuv2VjZWL8ZH5qY483uu9O4ccyrCtUa9WE9smadXkNhoCGj0iuTeXkRQYw1IMHp3Sy8J8493VjTBFapr-tT88Dy3grJqYlLIVHEcauryTt84xm8kP6xY Sep 01 16:48:50.280768 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 01 16:48:50.280768 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 01 16:48:50.280768 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 01 16:48:50.280768 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 01 16:48:50.280768 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 01 16:48:50.280768 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 01 16:48:50.280768 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Id: 3b373831f3c5412eb2170fef6580c110 Sep 01 16:48:50.280768 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-TestMinimumBasicScenario-1148702497 Sep 01 16:48:50.280768 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 01 16:48:50.280768 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 01 16:48:50.283673 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/3b373831f3c5412eb2170fef6580c110"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/3b373831f3c5412eb2170fef6580c110"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_3b373831f3c5412eb2170fef6580c110"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/3b373831f3c5412eb2170fef6580c110"}]}] Sep 01 16:48:50.283673 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-TestMinimumBasicScenario-1148702497 Sep 01 16:48:50.283673 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Id: 3b373831f3c5412eb2170fef6580c110 Sep 01 16:48:50.283673 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1148702497 Sep 01 16:48:50.283673 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User: tempest-TestMinimumBasicScenario-1148702497-project Sep 01 16:48:50.283673 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 01 16:48:50.283673 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 01 16:48:50.283673 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Id: d762a5837f034fc2aafa0efa33708530 Sep 01 16:48:50.283673 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-TestMinimumBasicScenario-1148702497-project Sep 01 16:48:50.283673 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: method: > Sep 01 16:48:50.283673 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: exception: Instance eb0c97da-94e3-4074-bc30-315c7bd7f149 is not attached to volume 983d21d3-2a13-4727-ad96-9450e1143a45 Sep 01 16:48:50.285348 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: action_args: {'server_id': 'eb0c97da-94e3-4074-bc30-315c7bd7f149', 'id': '983d21d3-2a13-4727-ad96-9450e1143a45'} Sep 01 16:48:50.285348 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:48:50.285348 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:48:50.285348 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 01 16:48:50.285348 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 01 16:48:50.285348 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 16:48:50.285348 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 16:48:50.285348 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 01 16:48:50.285348 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 01 16:48:50.285348 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 983d21d3-2a13-4727-ad96-9450e1143a45. Sep 01 16:48:50.285348 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:48:50.285348 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:48:50.285348 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:48:50.285348 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:48:50.285348 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:48:50.285348 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:48:50.285348 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:48:50.285348 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:48:50.285348 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:48:50.287191 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:48:50.287191 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 01 16:48:50.287191 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 01 16:48:50.287191 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb0c97da-94e3-4074-bc30-315c7bd7f149 is not attached to volume 983d21d3-2a13-4727-ad96-9450e1143a45 Sep 01 16:48:50.287191 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:48:50.287191 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:48:50.287191 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:48:50.287191 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:48:50.287191 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:48:50.287191 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:48:50.287191 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:48:50.287191 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:48:50.287191 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb0c97da-94e3-4074-bc30-315c7bd7f149 is not attached to volume 983d21d3-2a13-4727-ad96-9450e1143a45 Sep 01 16:48:50.287191 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:48:50.287191 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-fbd174bd-7d6b-42b3-85e8-434ffdaac94b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Returning 404 to user: Instance eb0c97da-94e3-4074-bc30-315c7bd7f149 is not attached to volume 983d21d3-2a13-4727-ad96-9450e1143a45 {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:48:50.291821 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-fbd174bd-7d6b-42b3-85e8-434ffdaac94b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "DELETE /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149/os-volume_attachments/983d21d3-2a13-4727-ad96-9450e1143a45" status: 404 len: 154 microversion: 2.1 time: 0.162230 Sep 01 16:48:50.291821 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 534/1041] 10.222.0.62 () {58 vars in 1416 bytes} [Thu Sep 1 16:48:50 2022] DELETE /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149/os-volume_attachments/983d21d3-2a13-4727-ad96-9450e1143a45 => generated 154 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:48:51.473493 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0f4594f5-1a64-4d06-bae2-dd05e7460a6d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:51.474323 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0f4594f5-1a64-4d06-bae2-dd05e7460a6d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:51.483869 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f4594f5-1a64-4d06-bae2-dd05e7460a6d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:51.484403 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f4594f5-1a64-4d06-bae2-dd05e7460a6d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:51.484833 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f4594f5-1a64-4d06-bae2-dd05e7460a6d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:51.485529 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f4594f5-1a64-4d06-bae2-dd05e7460a6d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:51.485971 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f4594f5-1a64-4d06-bae2-dd05e7460a6d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:51.486385 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0f4594f5-1a64-4d06-bae2-dd05e7460a6d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:51.521690 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0f4594f5-1a64-4d06-bae2-dd05e7460a6d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Going to try to terminate instance {{(pid=127198) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:48:51.625418 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0f4594f5-1a64-4d06-bae2-dd05e7460a6d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "DELETE /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149" status: 204 len: 0 microversion: 2.1 time: 0.155368 Sep 01 16:48:51.626033 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 508/1042] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Sep 1 16:48:51 2022] DELETE /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:48:51.636609 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-4700b490-7f5d-476a-af99-08b3f776235d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:51.637596 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-4700b490-7f5d-476a-af99-08b3f776235d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:51.645045 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4700b490-7f5d-476a-af99-08b3f776235d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:51.645526 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4700b490-7f5d-476a-af99-08b3f776235d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:51.646002 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4700b490-7f5d-476a-af99-08b3f776235d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:51.646834 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4700b490-7f5d-476a-af99-08b3f776235d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:51.647288 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4700b490-7f5d-476a-af99-08b3f776235d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:51.647755 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4700b490-7f5d-476a-af99-08b3f776235d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:51.822987 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-4700b490-7f5d-476a-af99-08b3f776235d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd762a5837f034fc2aafa0efa33708530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b373831f3c5412eb2170fef6580c110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:51.834090 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-4700b490-7f5d-476a-af99-08b3f776235d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149" status: 200 len: 1553 microversion: 2.1 time: 0.202464 Sep 01 16:48:51.834696 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 535/1043] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:51 2022] GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149 => generated 1553 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:52.861180 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-096bba3b-22ef-4f8f-a66d-d461cf55ac15 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:52.862440 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-096bba3b-22ef-4f8f-a66d-d461cf55ac15 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:52.874221 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-096bba3b-22ef-4f8f-a66d-d461cf55ac15 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:52.874992 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-096bba3b-22ef-4f8f-a66d-d461cf55ac15 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:52.875785 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-096bba3b-22ef-4f8f-a66d-d461cf55ac15 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:52.877150 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-096bba3b-22ef-4f8f-a66d-d461cf55ac15 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:52.877997 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-096bba3b-22ef-4f8f-a66d-d461cf55ac15 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:52.878747 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-096bba3b-22ef-4f8f-a66d-d461cf55ac15 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:53.038866 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-096bba3b-22ef-4f8f-a66d-d461cf55ac15 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd762a5837f034fc2aafa0efa33708530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b373831f3c5412eb2170fef6580c110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:53.049191 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-096bba3b-22ef-4f8f-a66d-d461cf55ac15 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149" status: 200 len: 1553 microversion: 2.1 time: 0.196339 Sep 01 16:48:53.049800 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 509/1044] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:52 2022] GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149 => generated 1553 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:54.002942 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-64bd84bf-378d-4f40-bdaf-951c87d6fa7c req-71ee53e5-8c8a-42e4-881f-64e084163f1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb0c97da-94e3-4074-bc30-315c7bd7f149", "name": "network-vif-deleted", "tag": "16e95cfd-eabb-4756-aff5-3331cb2f2007"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:48:54.022168 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-64bd84bf-378d-4f40-bdaf-951c87d6fa7c req-71ee53e5-8c8a-42e4-881f-64e084163f1c service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:54.023038 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-64bd84bf-378d-4f40-bdaf-951c87d6fa7c req-71ee53e5-8c8a-42e4-881f-64e084163f1c service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:54.024223 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-64bd84bf-378d-4f40-bdaf-951c87d6fa7c req-71ee53e5-8c8a-42e4-881f-64e084163f1c service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:54.048120 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-64bd84bf-378d-4f40-bdaf-951c87d6fa7c req-71ee53e5-8c8a-42e4-881f-64e084163f1c service nova] Creating event network-vif-deleted:16e95cfd-eabb-4756-aff5-3331cb2f2007 for instance eb0c97da-94e3-4074-bc30-315c7bd7f149 on hv-cinder-85221 Sep 01 16:48:54.058420 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-64bd84bf-378d-4f40-bdaf-951c87d6fa7c req-71ee53e5-8c8a-42e4-881f-64e084163f1c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063721 Sep 01 16:48:54.060279 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 536/1045] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:48:54.075379 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-441d6f41-659a-426f-adad-bce6a7b5610d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:54.084442 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-441d6f41-659a-426f-adad-bce6a7b5610d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:54.093741 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-441d6f41-659a-426f-adad-bce6a7b5610d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:54.094609 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-441d6f41-659a-426f-adad-bce6a7b5610d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:54.095350 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-441d6f41-659a-426f-adad-bce6a7b5610d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:54.096527 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-441d6f41-659a-426f-adad-bce6a7b5610d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:54.097242 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-441d6f41-659a-426f-adad-bce6a7b5610d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:54.097933 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-441d6f41-659a-426f-adad-bce6a7b5610d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:54.202559 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-441d6f41-659a-426f-adad-bce6a7b5610d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd762a5837f034fc2aafa0efa33708530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b373831f3c5412eb2170fef6580c110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:54.216583 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-441d6f41-659a-426f-adad-bce6a7b5610d tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149" status: 200 len: 1343 microversion: 2.1 time: 0.147891 Sep 01 16:48:54.217579 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 510/1046] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:54 2022] GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149 => generated 1343 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:48:55.246547 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7133946d-126b-498e-be28-c2fcc344ca17 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:55.247261 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-7133946d-126b-498e-be28-c2fcc344ca17 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] [instance: eb0c97da-94e3-4074-bc30-315c7bd7f149] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:55.257497 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7133946d-126b-498e-be28-c2fcc344ca17 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:55.258404 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7133946d-126b-498e-be28-c2fcc344ca17 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:55.259181 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7133946d-126b-498e-be28-c2fcc344ca17 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:55.260425 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7133946d-126b-498e-be28-c2fcc344ca17 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:55.261138 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7133946d-126b-498e-be28-c2fcc344ca17 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:55.261618 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7133946d-126b-498e-be28-c2fcc344ca17 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:55.279830 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-7133946d-126b-498e-be28-c2fcc344ca17 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] HTTP exception thrown: Instance eb0c97da-94e3-4074-bc30-315c7bd7f149 could not be found. Sep 01 16:48:55.281658 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7133946d-126b-498e-be28-c2fcc344ca17 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Request method failure captured: Sep 01 16:48:55.281658 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: request: GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149 HTTP/1.1 Sep 01 16:48:55.281658 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 01 16:48:55.281658 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 01 16:48:55.281658 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Connection: close Sep 01 16:48:55.281658 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 01 16:48:55.281658 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 01 16:48:55.281658 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Host: 10.222.0.62 Sep 01 16:48:55.281658 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 01 16:48:55.281658 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 01 16:48:55.281658 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjEOHwNmm1j7zUCLplLORBMa90aHQL4rCvMWZPW1s7CCFrx6Nj7Wd7oWmbfXdkuv2VjZWL8ZH5qY483uu9O4ccyrCtUa9WE9smadXkNhoCGj0iuTeXkRQYw1IMHp3Sy8J8493VjTBFapr-tT88Dy3grJqYlLIVHEcauryTt84xm8kP6xY Sep 01 16:48:55.281658 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 01 16:48:55.281658 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 01 16:48:55.281658 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 01 16:48:55.281658 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 01 16:48:55.281658 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 01 16:48:55.281658 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 01 16:48:55.281658 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Id: 3b373831f3c5412eb2170fef6580c110 Sep 01 16:48:55.281658 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-TestMinimumBasicScenario-1148702497 Sep 01 16:48:55.281658 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 01 16:48:55.281658 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 01 16:48:55.284238 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/3b373831f3c5412eb2170fef6580c110"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/3b373831f3c5412eb2170fef6580c110"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_3b373831f3c5412eb2170fef6580c110"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/3b373831f3c5412eb2170fef6580c110"}]}] Sep 01 16:48:55.284238 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-TestMinimumBasicScenario-1148702497 Sep 01 16:48:55.284238 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Id: 3b373831f3c5412eb2170fef6580c110 Sep 01 16:48:55.284238 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1148702497 Sep 01 16:48:55.284238 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User: tempest-TestMinimumBasicScenario-1148702497-project Sep 01 16:48:55.284238 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 01 16:48:55.284238 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 01 16:48:55.284238 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Id: d762a5837f034fc2aafa0efa33708530 Sep 01 16:48:55.284238 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-TestMinimumBasicScenario-1148702497-project Sep 01 16:48:55.284238 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: method: > Sep 01 16:48:55.284238 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: exception: Instance eb0c97da-94e3-4074-bc30-315c7bd7f149 could not be found. Sep 01 16:48:55.284238 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: action_args: {'id': 'eb0c97da-94e3-4074-bc30-315c7bd7f149'} Sep 01 16:48:55.285848 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:48:55.285848 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:48:55.285848 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:48:55.285848 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:48:55.285848 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:48:55.285848 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:48:55.285848 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:48:55.285848 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:48:55.285848 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:48:55.285848 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:48:55.285848 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb0c97da-94e3-4074-bc30-315c7bd7f149 could not be found. Sep 01 16:48:55.285848 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:48:55.285848 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:48:55.285848 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:48:55.285848 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:48:55.285848 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:48:55.285848 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:48:55.285848 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:48:55.285848 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:48:55.285848 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:48:55.288188 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:48:55.288188 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:48:55.288188 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:48:55.288188 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:48:55.288188 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:48:55.288188 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:48:55.288188 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:48:55.288188 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb0c97da-94e3-4074-bc30-315c7bd7f149 could not be found. Sep 01 16:48:55.288188 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:48:55.288188 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:48:55.288188 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:48:55.288188 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:48:55.288188 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:48:55.288188 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:48:55.288188 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:48:55.288188 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:48:55.288188 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb0c97da-94e3-4074-bc30-315c7bd7f149 could not be found. Sep 01 16:48:55.288188 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:48:55.290669 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7133946d-126b-498e-be28-c2fcc344ca17 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Returning 404 to user: Instance eb0c97da-94e3-4074-bc30-315c7bd7f149 could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:48:55.290669 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-7133946d-126b-498e-be28-c2fcc344ca17 tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149" status: 404 len: 111 microversion: 2.1 time: 0.042114 Sep 01 16:48:55.290669 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 537/1047] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:55 2022] GET /compute/v2.1/servers/eb0c97da-94e3-4074-bc30-315c7bd7f149 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:48:55.295046 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c3413115-54bf-41b5-8071-f7f70c46ff9b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] Calling method '.version_select at 0x7f94826a03a0>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:55.320282 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c3413115-54bf-41b5-8071-f7f70c46ff9b tempest-TestMinimumBasicScenario-1148702497 tempest-TestMinimumBasicScenario-1148702497-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-597618003" status: 202 len: 0 microversion: 2.1 time: 0.029123 Sep 01 16:48:55.326386 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 511/1048] 10.222.0.62 () {58 vars in 1269 bytes} [Thu Sep 1 16:48:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-597618003 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:49:14.592713 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-011a873b-9353-4325-8dad-9ca6f22da5c4 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-34723181", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1926683814", "security_groups": [{"name": "tempest-secgroup-smoke-505739473"}], "block_device_mapping_v2": [{"uuid": "e2a182ad-320c-4da4-bc55-2868538a54b2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d4d42d28-c5d6-49fb-b45c-004cc9c36c1c"}]}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:49:14.610086 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=14 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:14.610975 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=26 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:14.778681 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.network.neutron [None req-011a873b-9353-4325-8dad-9ca6f22da5c4 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] validate_networks() for [('d4d42d28-c5d6-49fb-b45c-004cc9c36c1c', None, None, None, None, None)] {{(pid=127199) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:49:15.315400 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-011a873b-9353-4325-8dad-9ca6f22da5c4 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Flavor limits 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:49:15.315820 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-011a873b-9353-4325-8dad-9ca6f22da5c4 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Image limits 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:49:15.316343 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-011a873b-9353-4325-8dad-9ca6f22da5c4 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Flavor pref 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:49:15.316778 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-011a873b-9353-4325-8dad-9ca6f22da5c4 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Image pref 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:49:15.319172 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-011a873b-9353-4325-8dad-9ca6f22da5c4 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:49:15.327731 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-011a873b-9353-4325-8dad-9ca6f22da5c4 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:49:15.328303 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-011a873b-9353-4325-8dad-9ca6f22da5c4 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:49:15.329135 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-011a873b-9353-4325-8dad-9ca6f22da5c4 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:49:15.329605 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-011a873b-9353-4325-8dad-9ca6f22da5c4 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:49:15.330057 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-011a873b-9353-4325-8dad-9ca6f22da5c4 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:49:15.331559 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-011a873b-9353-4325-8dad-9ca6f22da5c4 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:49:15.353335 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-011a873b-9353-4325-8dad-9ca6f22da5c4 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Getting quotas for project ec4d86f1d7bc4cc9a39ff55d4dc6a801. Resources: {'ram', 'cores', 'instances'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:49:15.359412 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-011a873b-9353-4325-8dad-9ca6f22da5c4 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Getting quotas for user ed4710f614cc431683a9c2a4f3d9d7b6 and project ec4d86f1d7bc4cc9a39ff55d4dc6a801. Resources: {'ram', 'cores', 'instances'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:49:15.433845 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-011a873b-9353-4325-8dad-9ca6f22da5c4 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Going to run 1 instances... {{(pid=127199) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:49:15.436406 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-011a873b-9353-4325-8dad-9ca6f22da5c4 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 606bd6be-436b-435c-8c59-870ee1f787dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e2a182ad-320c-4da4-bc55-2868538a54b2',volume_size=None,volume_type=None)] {{(pid=127199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:49:15.621943 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-011a873b-9353-4325-8dad-9ca6f22da5c4 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.034775 Sep 01 16:49:15.623625 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 538/1049] 10.222.0.62 () {60 vars in 1147 bytes} [Thu Sep 1 16:49:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 1038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:49:15.633364 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:15.634998 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:15.640767 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-1b406075-259f-4e32-8e97-43b95ff8397c tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:49:15.641386 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-1b406075-259f-4e32-8e97-43b95ff8397c tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 606bd6be-436b-435c-8c59-870ee1f787dd] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:49:15.719092 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-1b406075-259f-4e32-8e97-43b95ff8397c tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:49:15.730417 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-1b406075-259f-4e32-8e97-43b95ff8397c tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/606bd6be-436b-435c-8c59-870ee1f787dd" status: 200 len: 1093 microversion: 2.1 time: 0.098676 Sep 01 16:49:15.731363 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 512/1050] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:49:15 2022] GET /compute/v2.1/servers/606bd6be-436b-435c-8c59-870ee1f787dd => generated 1093 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:49:16.761759 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-36263f8b-597f-4f7e-a050-e7b69f639511 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:49:16.762374 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-36263f8b-597f-4f7e-a050-e7b69f639511 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 606bd6be-436b-435c-8c59-870ee1f787dd] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:49:16.771368 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-36263f8b-597f-4f7e-a050-e7b69f639511 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:49:16.771875 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-36263f8b-597f-4f7e-a050-e7b69f639511 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:49:16.772342 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-36263f8b-597f-4f7e-a050-e7b69f639511 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:49:16.773057 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-36263f8b-597f-4f7e-a050-e7b69f639511 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:49:16.773595 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-36263f8b-597f-4f7e-a050-e7b69f639511 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:49:16.774369 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-36263f8b-597f-4f7e-a050-e7b69f639511 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:49:16.879961 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-36263f8b-597f-4f7e-a050-e7b69f639511 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:49:16.894668 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-36263f8b-597f-4f7e-a050-e7b69f639511 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/606bd6be-436b-435c-8c59-870ee1f787dd" status: 200 len: 1191 microversion: 2.1 time: 0.137419 Sep 01 16:49:16.896943 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 539/1051] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:49:16 2022] GET /compute/v2.1/servers/606bd6be-436b-435c-8c59-870ee1f787dd => generated 1191 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:49:17.931232 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-c5ad9ef4-e7f4-4cd8-b7f3-c21113b3d48e tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:49:17.931232 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-c5ad9ef4-e7f4-4cd8-b7f3-c21113b3d48e tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 606bd6be-436b-435c-8c59-870ee1f787dd] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:49:17.940685 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c5ad9ef4-e7f4-4cd8-b7f3-c21113b3d48e tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:49:17.940993 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c5ad9ef4-e7f4-4cd8-b7f3-c21113b3d48e tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:49:17.941958 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c5ad9ef4-e7f4-4cd8-b7f3-c21113b3d48e tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:49:17.942697 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c5ad9ef4-e7f4-4cd8-b7f3-c21113b3d48e tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:49:17.943350 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c5ad9ef4-e7f4-4cd8-b7f3-c21113b3d48e tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:49:17.943983 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-c5ad9ef4-e7f4-4cd8-b7f3-c21113b3d48e tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:49:18.234884 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-c5ad9ef4-e7f4-4cd8-b7f3-c21113b3d48e tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:49:18.249268 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-c5ad9ef4-e7f4-4cd8-b7f3-c21113b3d48e tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/606bd6be-436b-435c-8c59-870ee1f787dd" status: 200 len: 1264 microversion: 2.1 time: 0.323014 Sep 01 16:49:18.250314 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 513/1052] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:49:17 2022] GET /compute/v2.1/servers/606bd6be-436b-435c-8c59-870ee1f787dd => generated 1264 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:49:18.727761 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-7c0881aa-77a0-486b-98f0-37f90ba399e3 req-e244d4f1-9f75-454d-9dc9-ad09b3077f9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "606bd6be-436b-435c-8c59-870ee1f787dd", "tag": "5834f9bc-6388-4419-bf23-60750057f2c2"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:49:18.743325 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-7c0881aa-77a0-486b-98f0-37f90ba399e3 req-e244d4f1-9f75-454d-9dc9-ad09b3077f9b service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:49:18.744216 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-7c0881aa-77a0-486b-98f0-37f90ba399e3 req-e244d4f1-9f75-454d-9dc9-ad09b3077f9b service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:49:18.744969 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-7c0881aa-77a0-486b-98f0-37f90ba399e3 req-e244d4f1-9f75-454d-9dc9-ad09b3077f9b service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:49:18.765654 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-7c0881aa-77a0-486b-98f0-37f90ba399e3 req-e244d4f1-9f75-454d-9dc9-ad09b3077f9b service nova] Creating event network-changed:5834f9bc-6388-4419-bf23-60750057f2c2 for instance 606bd6be-436b-435c-8c59-870ee1f787dd on hv-cinder-85221 Sep 01 16:49:18.771759 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-7c0881aa-77a0-486b-98f0-37f90ba399e3 req-e244d4f1-9f75-454d-9dc9-ad09b3077f9b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049995 Sep 01 16:49:18.772676 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 540/1053] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:49:19.275492 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-98dfdcd7-e4b8-4a5e-8bc6-c4c10e694cac tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:49:19.276162 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-98dfdcd7-e4b8-4a5e-8bc6-c4c10e694cac tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 606bd6be-436b-435c-8c59-870ee1f787dd] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:49:19.286041 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-98dfdcd7-e4b8-4a5e-8bc6-c4c10e694cac tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:49:19.286516 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-98dfdcd7-e4b8-4a5e-8bc6-c4c10e694cac tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:49:19.286954 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-98dfdcd7-e4b8-4a5e-8bc6-c4c10e694cac tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:49:19.287663 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-98dfdcd7-e4b8-4a5e-8bc6-c4c10e694cac tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:49:19.288147 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-98dfdcd7-e4b8-4a5e-8bc6-c4c10e694cac tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:49:19.288566 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-98dfdcd7-e4b8-4a5e-8bc6-c4c10e694cac tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:49:19.462221 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-98dfdcd7-e4b8-4a5e-8bc6-c4c10e694cac tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:49:19.477314 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-98dfdcd7-e4b8-4a5e-8bc6-c4c10e694cac tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/606bd6be-436b-435c-8c59-870ee1f787dd" status: 200 len: 1264 microversion: 2.1 time: 0.205812 Sep 01 16:49:19.478648 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 514/1054] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:49:19 2022] GET /compute/v2.1/servers/606bd6be-436b-435c-8c59-870ee1f787dd => generated 1264 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:49:20.505228 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-899f46e7-85b1-4453-ae10-dc6121975e01 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:49:20.505953 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-899f46e7-85b1-4453-ae10-dc6121975e01 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 606bd6be-436b-435c-8c59-870ee1f787dd] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:49:20.513471 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-899f46e7-85b1-4453-ae10-dc6121975e01 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:49:20.513954 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-899f46e7-85b1-4453-ae10-dc6121975e01 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:49:20.514389 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-899f46e7-85b1-4453-ae10-dc6121975e01 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:49:20.515101 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-899f46e7-85b1-4453-ae10-dc6121975e01 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:49:20.515548 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-899f46e7-85b1-4453-ae10-dc6121975e01 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:49:20.516392 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-899f46e7-85b1-4453-ae10-dc6121975e01 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:49:20.684127 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-899f46e7-85b1-4453-ae10-dc6121975e01 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:49:20.692792 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-899f46e7-85b1-4453-ae10-dc6121975e01 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/606bd6be-436b-435c-8c59-870ee1f787dd" status: 200 len: 1264 microversion: 2.1 time: 0.193047 Sep 01 16:49:20.693380 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 541/1055] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:49:20 2022] GET /compute/v2.1/servers/606bd6be-436b-435c-8c59-870ee1f787dd => generated 1264 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:49:21.717726 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-de1fbd29-f58b-485e-8ed4-8afc19cf4142 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:49:21.718620 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-de1fbd29-f58b-485e-8ed4-8afc19cf4142 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 606bd6be-436b-435c-8c59-870ee1f787dd] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:49:21.725617 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-de1fbd29-f58b-485e-8ed4-8afc19cf4142 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:49:21.726112 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-de1fbd29-f58b-485e-8ed4-8afc19cf4142 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:49:21.726551 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-de1fbd29-f58b-485e-8ed4-8afc19cf4142 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:49:21.728037 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-de1fbd29-f58b-485e-8ed4-8afc19cf4142 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:49:21.728478 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-de1fbd29-f58b-485e-8ed4-8afc19cf4142 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:49:21.728998 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-de1fbd29-f58b-485e-8ed4-8afc19cf4142 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:49:21.900501 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-de1fbd29-f58b-485e-8ed4-8afc19cf4142 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:49:21.908909 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-de1fbd29-f58b-485e-8ed4-8afc19cf4142 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/606bd6be-436b-435c-8c59-870ee1f787dd" status: 200 len: 1264 microversion: 2.1 time: 0.195264 Sep 01 16:49:21.909502 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 515/1056] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:49:21 2022] GET /compute/v2.1/servers/606bd6be-436b-435c-8c59-870ee1f787dd => generated 1264 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:49:22.932297 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ea8091fd-7fea-47ca-ae7a-36114cf042b8 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:49:22.932297 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ea8091fd-7fea-47ca-ae7a-36114cf042b8 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 606bd6be-436b-435c-8c59-870ee1f787dd] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:49:22.941652 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ea8091fd-7fea-47ca-ae7a-36114cf042b8 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:49:22.942237 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ea8091fd-7fea-47ca-ae7a-36114cf042b8 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:49:22.942686 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ea8091fd-7fea-47ca-ae7a-36114cf042b8 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:49:22.943392 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ea8091fd-7fea-47ca-ae7a-36114cf042b8 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:49:22.943846 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ea8091fd-7fea-47ca-ae7a-36114cf042b8 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:49:22.944316 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ea8091fd-7fea-47ca-ae7a-36114cf042b8 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:49:23.121474 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ea8091fd-7fea-47ca-ae7a-36114cf042b8 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:49:23.130458 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ea8091fd-7fea-47ca-ae7a-36114cf042b8 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/606bd6be-436b-435c-8c59-870ee1f787dd" status: 200 len: 1264 microversion: 2.1 time: 0.202978 Sep 01 16:49:23.131157 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 542/1057] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:49:22 2022] GET /compute/v2.1/servers/606bd6be-436b-435c-8c59-870ee1f787dd => generated 1264 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:49:24.153440 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-eb85eeb0-a88a-43c0-a86c-a619eb8417fc tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:49:24.154236 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-eb85eeb0-a88a-43c0-a86c-a619eb8417fc tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 606bd6be-436b-435c-8c59-870ee1f787dd] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:49:24.161214 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eb85eeb0-a88a-43c0-a86c-a619eb8417fc tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:49:24.161708 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eb85eeb0-a88a-43c0-a86c-a619eb8417fc tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:49:24.162165 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eb85eeb0-a88a-43c0-a86c-a619eb8417fc tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:49:24.162866 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eb85eeb0-a88a-43c0-a86c-a619eb8417fc tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:49:24.163576 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eb85eeb0-a88a-43c0-a86c-a619eb8417fc tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:49:24.164352 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-eb85eeb0-a88a-43c0-a86c-a619eb8417fc tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:49:24.323432 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-eb85eeb0-a88a-43c0-a86c-a619eb8417fc tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:49:24.332343 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-eb85eeb0-a88a-43c0-a86c-a619eb8417fc tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/606bd6be-436b-435c-8c59-870ee1f787dd" status: 200 len: 1264 microversion: 2.1 time: 0.183515 Sep 01 16:49:24.332950 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 516/1058] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:49:24 2022] GET /compute/v2.1/servers/606bd6be-436b-435c-8c59-870ee1f787dd => generated 1264 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:49:25.356348 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=2 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:25.367799 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=6 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:25.492691 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-57cf42a9-ec74-416c-b6c0-56cd720e64fb tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:49:25.493515 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-57cf42a9-ec74-416c-b6c0-56cd720e64fb tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 606bd6be-436b-435c-8c59-870ee1f787dd] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:49:25.500331 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-57cf42a9-ec74-416c-b6c0-56cd720e64fb tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:49:25.500875 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-57cf42a9-ec74-416c-b6c0-56cd720e64fb tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:49:25.501453 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-57cf42a9-ec74-416c-b6c0-56cd720e64fb tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:49:25.502215 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-57cf42a9-ec74-416c-b6c0-56cd720e64fb tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:49:25.502799 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-57cf42a9-ec74-416c-b6c0-56cd720e64fb tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:49:25.503262 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-57cf42a9-ec74-416c-b6c0-56cd720e64fb tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:49:25.656626 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-57cf42a9-ec74-416c-b6c0-56cd720e64fb tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:49:25.665279 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-57cf42a9-ec74-416c-b6c0-56cd720e64fb tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/606bd6be-436b-435c-8c59-870ee1f787dd" status: 200 len: 1264 microversion: 2.1 time: 0.314188 Sep 01 16:49:25.666081 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 543/1059] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:49:25 2022] GET /compute/v2.1/servers/606bd6be-436b-435c-8c59-870ee1f787dd => generated 1264 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:49:26.687649 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-040830c2-a5f8-4f6b-9201-302ce8ddc80d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:49:26.688301 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-040830c2-a5f8-4f6b-9201-302ce8ddc80d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 606bd6be-436b-435c-8c59-870ee1f787dd] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:49:26.690760 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell0:SELECT=2 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:26.697001 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-040830c2-a5f8-4f6b-9201-302ce8ddc80d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:49:26.697498 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-040830c2-a5f8-4f6b-9201-302ce8ddc80d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:49:26.697933 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-040830c2-a5f8-4f6b-9201-302ce8ddc80d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:49:26.698645 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-040830c2-a5f8-4f6b-9201-302ce8ddc80d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:49:26.699185 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-040830c2-a5f8-4f6b-9201-302ce8ddc80d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:49:26.699529 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-040830c2-a5f8-4f6b-9201-302ce8ddc80d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:49:26.880036 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-040830c2-a5f8-4f6b-9201-302ce8ddc80d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:49:26.894571 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-040830c2-a5f8-4f6b-9201-302ce8ddc80d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/606bd6be-436b-435c-8c59-870ee1f787dd" status: 200 len: 1264 microversion: 2.1 time: 0.210773 Sep 01 16:49:26.895227 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 517/1060] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:49:26 2022] GET /compute/v2.1/servers/606bd6be-436b-435c-8c59-870ee1f787dd => generated 1264 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:49:27.918783 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-11629121-bbcd-4d66-9953-c63d812e446b tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:49:27.919577 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-11629121-bbcd-4d66-9953-c63d812e446b tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 606bd6be-436b-435c-8c59-870ee1f787dd] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:49:27.928339 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-11629121-bbcd-4d66-9953-c63d812e446b tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:49:27.929019 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-11629121-bbcd-4d66-9953-c63d812e446b tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:49:27.929557 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-11629121-bbcd-4d66-9953-c63d812e446b tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:49:27.930478 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-11629121-bbcd-4d66-9953-c63d812e446b tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:49:27.931127 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-11629121-bbcd-4d66-9953-c63d812e446b tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:49:27.931834 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-11629121-bbcd-4d66-9953-c63d812e446b tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:49:28.262743 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-11629121-bbcd-4d66-9953-c63d812e446b tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:49:28.272658 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-11629121-bbcd-4d66-9953-c63d812e446b tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/606bd6be-436b-435c-8c59-870ee1f787dd" status: 200 len: 1264 microversion: 2.1 time: 0.358989 Sep 01 16:49:28.273255 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 544/1061] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:49:27 2022] GET /compute/v2.1/servers/606bd6be-436b-435c-8c59-870ee1f787dd => generated 1264 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:49:29.299506 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e9d9c3b8-4d3a-43a3-a9ad-f0380612f12c tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:49:29.300387 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e9d9c3b8-4d3a-43a3-a9ad-f0380612f12c tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 606bd6be-436b-435c-8c59-870ee1f787dd] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:49:29.307984 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e9d9c3b8-4d3a-43a3-a9ad-f0380612f12c tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:49:29.308750 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e9d9c3b8-4d3a-43a3-a9ad-f0380612f12c tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:49:29.309459 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e9d9c3b8-4d3a-43a3-a9ad-f0380612f12c tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:49:29.310228 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e9d9c3b8-4d3a-43a3-a9ad-f0380612f12c tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:49:29.310688 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e9d9c3b8-4d3a-43a3-a9ad-f0380612f12c tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:49:29.311109 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e9d9c3b8-4d3a-43a3-a9ad-f0380612f12c tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:49:29.474918 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e9d9c3b8-4d3a-43a3-a9ad-f0380612f12c tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:49:29.484324 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e9d9c3b8-4d3a-43a3-a9ad-f0380612f12c tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/606bd6be-436b-435c-8c59-870ee1f787dd" status: 200 len: 1264 microversion: 2.1 time: 0.188692 Sep 01 16:49:29.484934 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 518/1062] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:49:29 2022] GET /compute/v2.1/servers/606bd6be-436b-435c-8c59-870ee1f787dd => generated 1264 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:49:29.972948 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-60b7c675-e5ac-4bc5-99c0-8350908caffe req-8e9cecdd-a228-467c-996c-f6a9224a646c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "606bd6be-436b-435c-8c59-870ee1f787dd", "name": "network-vif-plugged", "status": "completed", "tag": "5834f9bc-6388-4419-bf23-60750057f2c2"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:49:29.984730 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-60b7c675-e5ac-4bc5-99c0-8350908caffe req-8e9cecdd-a228-467c-996c-f6a9224a646c service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:49:29.985280 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-60b7c675-e5ac-4bc5-99c0-8350908caffe req-8e9cecdd-a228-467c-996c-f6a9224a646c service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:49:29.985840 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-60b7c675-e5ac-4bc5-99c0-8350908caffe req-8e9cecdd-a228-467c-996c-f6a9224a646c service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:49:29.998764 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-60b7c675-e5ac-4bc5-99c0-8350908caffe req-8e9cecdd-a228-467c-996c-f6a9224a646c service nova] Creating event network-vif-plugged:5834f9bc-6388-4419-bf23-60750057f2c2 for instance 606bd6be-436b-435c-8c59-870ee1f787dd on hv-cinder-85221 Sep 01 16:49:30.003791 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-60b7c675-e5ac-4bc5-99c0-8350908caffe req-8e9cecdd-a228-467c-996c-f6a9224a646c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034923 Sep 01 16:49:30.004421 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 545/1063] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:49:30.508684 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-e294a5af-aefc-463c-9089-b552a495e4fc tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:49:30.509341 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-e294a5af-aefc-463c-9089-b552a495e4fc tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 606bd6be-436b-435c-8c59-870ee1f787dd] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:49:30.516966 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e294a5af-aefc-463c-9089-b552a495e4fc tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:49:30.517453 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e294a5af-aefc-463c-9089-b552a495e4fc tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:49:30.517892 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e294a5af-aefc-463c-9089-b552a495e4fc tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:49:30.518591 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e294a5af-aefc-463c-9089-b552a495e4fc tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:49:30.519048 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e294a5af-aefc-463c-9089-b552a495e4fc tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:49:30.519471 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-e294a5af-aefc-463c-9089-b552a495e4fc tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:49:30.660983 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-e294a5af-aefc-463c-9089-b552a495e4fc tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:49:30.669256 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-e294a5af-aefc-463c-9089-b552a495e4fc tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/606bd6be-436b-435c-8c59-870ee1f787dd" status: 200 len: 1264 microversion: 2.1 time: 0.166943 Sep 01 16:49:30.669848 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 519/1064] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:49:30 2022] GET /compute/v2.1/servers/606bd6be-436b-435c-8c59-870ee1f787dd => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:49:31.693891 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8d015e7a-2e80-4676-8824-64ef1b09589d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:49:31.694640 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-8d015e7a-2e80-4676-8824-64ef1b09589d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 606bd6be-436b-435c-8c59-870ee1f787dd] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:49:31.704631 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8d015e7a-2e80-4676-8824-64ef1b09589d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:49:31.705215 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8d015e7a-2e80-4676-8824-64ef1b09589d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:49:31.705822 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8d015e7a-2e80-4676-8824-64ef1b09589d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:49:31.706920 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8d015e7a-2e80-4676-8824-64ef1b09589d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:49:31.707625 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8d015e7a-2e80-4676-8824-64ef1b09589d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:49:31.708422 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8d015e7a-2e80-4676-8824-64ef1b09589d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:49:31.869330 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8d015e7a-2e80-4676-8824-64ef1b09589d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:49:31.877441 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8d015e7a-2e80-4676-8824-64ef1b09589d tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/606bd6be-436b-435c-8c59-870ee1f787dd" status: 200 len: 1451 microversion: 2.1 time: 0.190518 Sep 01 16:49:31.878032 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 546/1065] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:49:31 2022] GET /compute/v2.1/servers/606bd6be-436b-435c-8c59-870ee1f787dd => generated 1451 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:49:31.898816 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7bd89e46-22ba-4d0e-800c-dca07e9ee01e tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:49:31.899411 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7bd89e46-22ba-4d0e-800c-dca07e9ee01e tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 606bd6be-436b-435c-8c59-870ee1f787dd] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:49:31.906473 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7bd89e46-22ba-4d0e-800c-dca07e9ee01e tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:49:31.906952 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7bd89e46-22ba-4d0e-800c-dca07e9ee01e tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:49:31.907381 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7bd89e46-22ba-4d0e-800c-dca07e9ee01e tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:49:31.908109 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7bd89e46-22ba-4d0e-800c-dca07e9ee01e tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:49:31.908543 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7bd89e46-22ba-4d0e-800c-dca07e9ee01e tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:49:31.908966 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7bd89e46-22ba-4d0e-800c-dca07e9ee01e tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:49:32.047859 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7bd89e46-22ba-4d0e-800c-dca07e9ee01e tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:49:32.056649 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7bd89e46-22ba-4d0e-800c-dca07e9ee01e tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/606bd6be-436b-435c-8c59-870ee1f787dd" status: 200 len: 1451 microversion: 2.1 time: 0.161953 Sep 01 16:49:32.057262 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 520/1066] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:49:31 2022] GET /compute/v2.1/servers/606bd6be-436b-435c-8c59-870ee1f787dd => generated 1451 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:49:34.103017 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-082009d5-981b-4495-be28-433cd20c7b87 req-dc9e619c-8192-477a-96bf-5e53a5c199bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "606bd6be-436b-435c-8c59-870ee1f787dd", "tag": "5834f9bc-6388-4419-bf23-60750057f2c2"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:49:34.117944 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-082009d5-981b-4495-be28-433cd20c7b87 req-dc9e619c-8192-477a-96bf-5e53a5c199bf service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:49:34.118445 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-082009d5-981b-4495-be28-433cd20c7b87 req-dc9e619c-8192-477a-96bf-5e53a5c199bf service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:49:34.119060 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-082009d5-981b-4495-be28-433cd20c7b87 req-dc9e619c-8192-477a-96bf-5e53a5c199bf service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:49:34.131490 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-082009d5-981b-4495-be28-433cd20c7b87 req-dc9e619c-8192-477a-96bf-5e53a5c199bf service nova] Creating event network-changed:5834f9bc-6388-4419-bf23-60750057f2c2 for instance 606bd6be-436b-435c-8c59-870ee1f787dd on hv-cinder-85221 Sep 01 16:49:34.137613 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-082009d5-981b-4495-be28-433cd20c7b87 req-dc9e619c-8192-477a-96bf-5e53a5c199bf service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039480 Sep 01 16:49:34.141479 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 547/1067] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:51:02.261070 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:51:02.262389 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-f9830805-fce2-4a62-a409-0354c3e76ee5 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:02.262908 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=44 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:51:02.263044 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f9830805-fce2-4a62-a409-0354c3e76ee5 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 606bd6be-436b-435c-8c59-870ee1f787dd] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:02.267143 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 16:51:02.267143 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Thu Sep 1 16:51:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.62) !!! Sep 01 16:51:02.267591 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 16:51:02.267591 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Thu Sep 1 16:51:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/606bd6be-436b-435c-8c59-870ee1f787dd (ip 10.222.0.62) !!! Sep 01 16:51:02.271041 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-d295ee90-39d6-475d-9293-2ac3452727c4 req-5a30ea17-822c-4f16-aed4-0a0a56b80ab6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "606bd6be-436b-435c-8c59-870ee1f787dd", "tag": "5834f9bc-6388-4419-bf23-60750057f2c2"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:51:02.271349 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_api:SELECT=20 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:51:02.272664 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG dbcounter [-] [127198] Writing DB stats nova_cell1:SELECT=48 {{(pid=127198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:51:02.274364 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 16:51:02.274364 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Thu Sep 1 16:51:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/606bd6be-436b-435c-8c59-870ee1f787dd (ip 10.222.0.62) !!! Sep 01 16:51:02.285399 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-d295ee90-39d6-475d-9293-2ac3452727c4 req-5a30ea17-822c-4f16-aed4-0a0a56b80ab6 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:02.286494 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-d295ee90-39d6-475d-9293-2ac3452727c4 req-5a30ea17-822c-4f16-aed4-0a0a56b80ab6 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:02.287258 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-d295ee90-39d6-475d-9293-2ac3452727c4 req-5a30ea17-822c-4f16-aed4-0a0a56b80ab6 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:02.298458 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f9830805-fce2-4a62-a409-0354c3e76ee5 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:02.298961 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f9830805-fce2-4a62-a409-0354c3e76ee5 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:02.299499 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f9830805-fce2-4a62-a409-0354c3e76ee5 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:02.300205 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f9830805-fce2-4a62-a409-0354c3e76ee5 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:02.300616 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f9830805-fce2-4a62-a409-0354c3e76ee5 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:02.301103 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-f9830805-fce2-4a62-a409-0354c3e76ee5 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:02.303305 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-d295ee90-39d6-475d-9293-2ac3452727c4 req-5a30ea17-822c-4f16-aed4-0a0a56b80ab6 service nova] Creating event network-changed:5834f9bc-6388-4419-bf23-60750057f2c2 for instance 606bd6be-436b-435c-8c59-870ee1f787dd on hv-cinder-85221 Sep 01 16:51:02.309419 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-d295ee90-39d6-475d-9293-2ac3452727c4 req-5a30ea17-822c-4f16-aed4-0a0a56b80ab6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050881 Sep 01 16:51:02.310350 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 548/1068] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:51:02.333124 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-f9830805-fce2-4a62-a409-0354c3e76ee5 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 606bd6be-436b-435c-8c59-870ee1f787dd] Going to try to terminate instance {{(pid=127198) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:51:02.444147 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-f9830805-fce2-4a62-a409-0354c3e76ee5 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "DELETE /compute/v2.1/servers/606bd6be-436b-435c-8c59-870ee1f787dd" status: 204 len: 0 microversion: 2.1 time: 0.188680 Sep 01 16:51:02.445004 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 521/1069] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Sep 1 16:51:02 2022] DELETE /compute/v2.1/servers/606bd6be-436b-435c-8c59-870ee1f787dd => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:51:02.458398 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-dfa45926-3728-4068-890c-13acab27b2fa tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:02.459519 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-dfa45926-3728-4068-890c-13acab27b2fa tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 606bd6be-436b-435c-8c59-870ee1f787dd] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:02.466980 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dfa45926-3728-4068-890c-13acab27b2fa tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:02.467924 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dfa45926-3728-4068-890c-13acab27b2fa tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:02.468584 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dfa45926-3728-4068-890c-13acab27b2fa tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:02.469519 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dfa45926-3728-4068-890c-13acab27b2fa tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:02.470215 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dfa45926-3728-4068-890c-13acab27b2fa tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:02.470918 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dfa45926-3728-4068-890c-13acab27b2fa tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:02.640338 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-dfa45926-3728-4068-890c-13acab27b2fa tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:02.649648 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-dfa45926-3728-4068-890c-13acab27b2fa tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/606bd6be-436b-435c-8c59-870ee1f787dd" status: 200 len: 1575 microversion: 2.1 time: 0.198677 Sep 01 16:51:02.650459 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 549/1070] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:02 2022] GET /compute/v2.1/servers/606bd6be-436b-435c-8c59-870ee1f787dd => generated 1575 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:51:03.672301 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-b229911c-3bc5-4296-8fea-4ec531e65aad tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:03.673016 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-b229911c-3bc5-4296-8fea-4ec531e65aad tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 606bd6be-436b-435c-8c59-870ee1f787dd] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:03.680474 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b229911c-3bc5-4296-8fea-4ec531e65aad tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:03.680993 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b229911c-3bc5-4296-8fea-4ec531e65aad tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:03.681415 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b229911c-3bc5-4296-8fea-4ec531e65aad tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:03.682111 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b229911c-3bc5-4296-8fea-4ec531e65aad tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:03.682588 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b229911c-3bc5-4296-8fea-4ec531e65aad tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:03.683011 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-b229911c-3bc5-4296-8fea-4ec531e65aad tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:03.870881 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-b229911c-3bc5-4296-8fea-4ec531e65aad tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:03.880212 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-b229911c-3bc5-4296-8fea-4ec531e65aad tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/606bd6be-436b-435c-8c59-870ee1f787dd" status: 200 len: 1575 microversion: 2.1 time: 0.212295 Sep 01 16:51:03.880818 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 522/1071] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:03 2022] GET /compute/v2.1/servers/606bd6be-436b-435c-8c59-870ee1f787dd => generated 1575 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:51:04.683902 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-f9ae7cfd-9e52-44f5-a4e2-44cb672ae6f0 req-c56db020-ba3e-4e7a-b514-b664499ac683 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "606bd6be-436b-435c-8c59-870ee1f787dd", "name": "network-vif-deleted", "tag": "5834f9bc-6388-4419-bf23-60750057f2c2"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:51:04.696337 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-f9ae7cfd-9e52-44f5-a4e2-44cb672ae6f0 req-c56db020-ba3e-4e7a-b514-b664499ac683 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:04.697463 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-f9ae7cfd-9e52-44f5-a4e2-44cb672ae6f0 req-c56db020-ba3e-4e7a-b514-b664499ac683 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:04.698016 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-f9ae7cfd-9e52-44f5-a4e2-44cb672ae6f0 req-c56db020-ba3e-4e7a-b514-b664499ac683 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:04.713170 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-f9ae7cfd-9e52-44f5-a4e2-44cb672ae6f0 req-c56db020-ba3e-4e7a-b514-b664499ac683 service nova] Creating event network-vif-deleted:5834f9bc-6388-4419-bf23-60750057f2c2 for instance 606bd6be-436b-435c-8c59-870ee1f787dd on hv-cinder-85221 Sep 01 16:51:04.718884 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-f9ae7cfd-9e52-44f5-a4e2-44cb672ae6f0 req-c56db020-ba3e-4e7a-b514-b664499ac683 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038812 Sep 01 16:51:04.719486 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 550/1072] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:51:04.902181 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-7c33c36e-3bda-4dfb-8a0e-a3a692ad3f6c tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:04.902832 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-7c33c36e-3bda-4dfb-8a0e-a3a692ad3f6c tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 606bd6be-436b-435c-8c59-870ee1f787dd] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:04.909797 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7c33c36e-3bda-4dfb-8a0e-a3a692ad3f6c tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:04.911051 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7c33c36e-3bda-4dfb-8a0e-a3a692ad3f6c tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:04.911051 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7c33c36e-3bda-4dfb-8a0e-a3a692ad3f6c tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:04.911700 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7c33c36e-3bda-4dfb-8a0e-a3a692ad3f6c tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:04.912201 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7c33c36e-3bda-4dfb-8a0e-a3a692ad3f6c tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:04.912619 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-7c33c36e-3bda-4dfb-8a0e-a3a692ad3f6c tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:04.986723 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-7c33c36e-3bda-4dfb-8a0e-a3a692ad3f6c tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:04.996822 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-7c33c36e-3bda-4dfb-8a0e-a3a692ad3f6c tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/606bd6be-436b-435c-8c59-870ee1f787dd" status: 200 len: 1224 microversion: 2.1 time: 0.098460 Sep 01 16:51:04.997435 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 523/1073] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:04 2022] GET /compute/v2.1/servers/606bd6be-436b-435c-8c59-870ee1f787dd => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:51:06.022042 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ae0008e3-2af3-4b85-a2e6-cd6147c86d67 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:06.022665 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ae0008e3-2af3-4b85-a2e6-cd6147c86d67 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 606bd6be-436b-435c-8c59-870ee1f787dd] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:06.029319 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ae0008e3-2af3-4b85-a2e6-cd6147c86d67 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:06.029807 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ae0008e3-2af3-4b85-a2e6-cd6147c86d67 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:06.030266 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ae0008e3-2af3-4b85-a2e6-cd6147c86d67 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:06.030975 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ae0008e3-2af3-4b85-a2e6-cd6147c86d67 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:06.031424 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ae0008e3-2af3-4b85-a2e6-cd6147c86d67 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:06.031843 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ae0008e3-2af3-4b85-a2e6-cd6147c86d67 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:06.047518 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-ae0008e3-2af3-4b85-a2e6-cd6147c86d67 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] HTTP exception thrown: Instance 606bd6be-436b-435c-8c59-870ee1f787dd could not be found. Sep 01 16:51:06.049241 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ae0008e3-2af3-4b85-a2e6-cd6147c86d67 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Request method failure captured: Sep 01 16:51:06.049241 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: request: GET /compute/v2.1/servers/606bd6be-436b-435c-8c59-870ee1f787dd HTTP/1.1 Sep 01 16:51:06.049241 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 01 16:51:06.049241 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 01 16:51:06.049241 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Connection: close Sep 01 16:51:06.049241 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 01 16:51:06.049241 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 01 16:51:06.049241 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Host: 10.222.0.62 Sep 01 16:51:06.049241 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 01 16:51:06.049241 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 01 16:51:06.049241 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjEOFgxM7SaieoAVHA3hJou9qbkQrDjV5SqFBHn9XOJxMUKZXdkp9ZNIp6jWYJ9WSbYIbpl-W4btkQ83Ls3MwrHbPLI1Mv4f8gTDSyCBjzpa9fbk1LsAfvVcdF3jiT22rYU2vS8wDFAGEDLHUGdEnIsOL3LBpvrta62S0uXl3RwkWed14 Sep 01 16:51:06.049241 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 01 16:51:06.049241 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 01 16:51:06.049241 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 01 16:51:06.049241 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 01 16:51:06.049241 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 01 16:51:06.049241 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 01 16:51:06.049241 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Id: ec4d86f1d7bc4cc9a39ff55d4dc6a801 Sep 01 16:51:06.049241 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-TestVolumeBootPattern-1869658126 Sep 01 16:51:06.049241 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 01 16:51:06.049241 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 01 16:51:06.051314 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ec4d86f1d7bc4cc9a39ff55d4dc6a801"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ec4d86f1d7bc4cc9a39ff55d4dc6a801"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ec4d86f1d7bc4cc9a39ff55d4dc6a801"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ec4d86f1d7bc4cc9a39ff55d4dc6a801"}]}] Sep 01 16:51:06.051314 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-TestVolumeBootPattern-1869658126 Sep 01 16:51:06.051314 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Id: ec4d86f1d7bc4cc9a39ff55d4dc6a801 Sep 01 16:51:06.051314 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-TestVolumeBootPattern-1869658126 Sep 01 16:51:06.051314 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User: tempest-TestVolumeBootPattern-1869658126-project Sep 01 16:51:06.051314 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 01 16:51:06.051314 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 01 16:51:06.051314 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Id: ed4710f614cc431683a9c2a4f3d9d7b6 Sep 01 16:51:06.051314 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-TestVolumeBootPattern-1869658126-project Sep 01 16:51:06.051314 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: method: > Sep 01 16:51:06.051314 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: exception: Instance 606bd6be-436b-435c-8c59-870ee1f787dd could not be found. Sep 01 16:51:06.051314 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: action_args: {'id': '606bd6be-436b-435c-8c59-870ee1f787dd'} Sep 01 16:51:06.052524 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:51:06.052524 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:51:06.052524 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:51:06.052524 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:51:06.052524 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:51:06.052524 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:51:06.052524 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:51:06.052524 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:51:06.052524 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:51:06.052524 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:51:06.052524 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 606bd6be-436b-435c-8c59-870ee1f787dd could not be found. Sep 01 16:51:06.052524 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:51:06.052524 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:51:06.052524 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:51:06.052524 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:51:06.052524 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:51:06.052524 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:51:06.052524 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:51:06.052524 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:51:06.052524 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:51:06.054297 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:51:06.054297 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:51:06.054297 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:51:06.054297 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:51:06.054297 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:51:06.054297 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:51:06.054297 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:51:06.054297 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 606bd6be-436b-435c-8c59-870ee1f787dd could not be found. Sep 01 16:51:06.054297 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:51:06.054297 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:51:06.054297 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:51:06.054297 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:51:06.054297 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:51:06.054297 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:51:06.054297 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:51:06.054297 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:51:06.054297 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 606bd6be-436b-435c-8c59-870ee1f787dd could not be found. Sep 01 16:51:06.054297 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:51:06.055864 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ae0008e3-2af3-4b85-a2e6-cd6147c86d67 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Returning 404 to user: Instance 606bd6be-436b-435c-8c59-870ee1f787dd could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:51:06.055864 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ae0008e3-2af3-4b85-a2e6-cd6147c86d67 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/606bd6be-436b-435c-8c59-870ee1f787dd" status: 404 len: 111 microversion: 2.1 time: 0.033846 Sep 01 16:51:06.055864 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 551/1074] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:06 2022] GET /compute/v2.1/servers/606bd6be-436b-435c-8c59-870ee1f787dd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:51:09.440987 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-0b33d911-ae9e-4c35-a08d-6f611bd8d077 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:09.441970 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-fece97a3-1bac-46ad-a38d-89a873244632 req-c929a601-5eeb-4ff1-b185-312aabcab384 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b402a148-2510-4b7a-99ff-71ac77e3854f", "tag": "5a7b13db-900a-4234-bb03-06023d66c959"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:51:09.442866 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0b33d911-ae9e-4c35-a08d-6f611bd8d077 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: b402a148-2510-4b7a-99ff-71ac77e3854f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:09.451469 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0b33d911-ae9e-4c35-a08d-6f611bd8d077 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:09.452270 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0b33d911-ae9e-4c35-a08d-6f611bd8d077 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:09.452957 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0b33d911-ae9e-4c35-a08d-6f611bd8d077 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:09.453289 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-fece97a3-1bac-46ad-a38d-89a873244632 req-c929a601-5eeb-4ff1-b185-312aabcab384 service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:09.453825 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-fece97a3-1bac-46ad-a38d-89a873244632 req-c929a601-5eeb-4ff1-b185-312aabcab384 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:09.454018 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0b33d911-ae9e-4c35-a08d-6f611bd8d077 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:09.454239 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-fece97a3-1bac-46ad-a38d-89a873244632 req-c929a601-5eeb-4ff1-b185-312aabcab384 service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:09.454624 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0b33d911-ae9e-4c35-a08d-6f611bd8d077 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:09.455328 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-0b33d911-ae9e-4c35-a08d-6f611bd8d077 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:09.472263 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-fece97a3-1bac-46ad-a38d-89a873244632 req-c929a601-5eeb-4ff1-b185-312aabcab384 service nova] Creating event network-changed:5a7b13db-900a-4234-bb03-06023d66c959 for instance b402a148-2510-4b7a-99ff-71ac77e3854f on hv-cinder-85221 Sep 01 16:51:09.485148 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-fece97a3-1bac-46ad-a38d-89a873244632 req-c929a601-5eeb-4ff1-b185-312aabcab384 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045923 Sep 01 16:51:09.486668 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 552/1075] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:51:09.511197 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-0b33d911-ae9e-4c35-a08d-6f611bd8d077 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: b402a148-2510-4b7a-99ff-71ac77e3854f] Going to try to terminate instance {{(pid=127198) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:51:09.649290 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-0b33d911-ae9e-4c35-a08d-6f611bd8d077 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "DELETE /compute/v2.1/servers/b402a148-2510-4b7a-99ff-71ac77e3854f" status: 204 len: 0 microversion: 2.1 time: 0.213029 Sep 01 16:51:09.656345 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 524/1076] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Sep 1 16:51:09 2022] DELETE /compute/v2.1/servers/b402a148-2510-4b7a-99ff-71ac77e3854f => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:51:09.669872 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b62be323-b6e1-4a6d-a262-074e9204c54e tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:09.671934 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-b62be323-b6e1-4a6d-a262-074e9204c54e tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: b402a148-2510-4b7a-99ff-71ac77e3854f] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:09.688063 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b62be323-b6e1-4a6d-a262-074e9204c54e tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:09.689162 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b62be323-b6e1-4a6d-a262-074e9204c54e tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:09.690103 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b62be323-b6e1-4a6d-a262-074e9204c54e tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:09.693408 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b62be323-b6e1-4a6d-a262-074e9204c54e tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:09.694478 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b62be323-b6e1-4a6d-a262-074e9204c54e tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:09.695091 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b62be323-b6e1-4a6d-a262-074e9204c54e tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:09.912903 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b62be323-b6e1-4a6d-a262-074e9204c54e tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:09.924459 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-b62be323-b6e1-4a6d-a262-074e9204c54e tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/b402a148-2510-4b7a-99ff-71ac77e3854f" status: 200 len: 1578 microversion: 2.1 time: 0.265709 Sep 01 16:51:09.925414 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 553/1077] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:09 2022] GET /compute/v2.1/servers/b402a148-2510-4b7a-99ff-71ac77e3854f => generated 1578 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:51:10.949356 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-a5fdc4e3-c774-4a1b-adc7-27f230a4fa35 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:10.950024 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-a5fdc4e3-c774-4a1b-adc7-27f230a4fa35 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: b402a148-2510-4b7a-99ff-71ac77e3854f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:10.957228 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a5fdc4e3-c774-4a1b-adc7-27f230a4fa35 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:10.958030 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a5fdc4e3-c774-4a1b-adc7-27f230a4fa35 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:10.959620 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a5fdc4e3-c774-4a1b-adc7-27f230a4fa35 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:10.959620 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a5fdc4e3-c774-4a1b-adc7-27f230a4fa35 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:10.960155 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a5fdc4e3-c774-4a1b-adc7-27f230a4fa35 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:10.960327 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-a5fdc4e3-c774-4a1b-adc7-27f230a4fa35 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:11.510715 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-a5fdc4e3-c774-4a1b-adc7-27f230a4fa35 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:11.519854 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-a5fdc4e3-c774-4a1b-adc7-27f230a4fa35 tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/b402a148-2510-4b7a-99ff-71ac77e3854f" status: 200 len: 1578 microversion: 2.1 time: 0.575350 Sep 01 16:51:11.520550 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 525/1078] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:10 2022] GET /compute/v2.1/servers/b402a148-2510-4b7a-99ff-71ac77e3854f => generated 1578 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:51:11.875364 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-26d79d4c-6492-4f76-abe2-56d26f7f7a19 req-11b716fe-87c1-4a03-816d-ca970a31369b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b402a148-2510-4b7a-99ff-71ac77e3854f", "name": "network-vif-deleted", "tag": "5a7b13db-900a-4234-bb03-06023d66c959"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:51:11.889552 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-26d79d4c-6492-4f76-abe2-56d26f7f7a19 req-11b716fe-87c1-4a03-816d-ca970a31369b service nova] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:11.890301 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-26d79d4c-6492-4f76-abe2-56d26f7f7a19 req-11b716fe-87c1-4a03-816d-ca970a31369b service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:11.891022 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-26d79d4c-6492-4f76-abe2-56d26f7f7a19 req-11b716fe-87c1-4a03-816d-ca970a31369b service nova] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:11.908933 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-26d79d4c-6492-4f76-abe2-56d26f7f7a19 req-11b716fe-87c1-4a03-816d-ca970a31369b service nova] Creating event network-vif-deleted:5a7b13db-900a-4234-bb03-06023d66c959 for instance b402a148-2510-4b7a-99ff-71ac77e3854f on hv-cinder-85221 Sep 01 16:51:11.914609 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-26d79d4c-6492-4f76-abe2-56d26f7f7a19 req-11b716fe-87c1-4a03-816d-ca970a31369b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045181 Sep 01 16:51:11.915625 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 554/1079] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Sep 1 16:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:51:12.545799 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-d67a4c3f-638c-40da-98a2-0f29a43c18eb tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:12.546659 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-d67a4c3f-638c-40da-98a2-0f29a43c18eb tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: b402a148-2510-4b7a-99ff-71ac77e3854f] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:12.556085 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d67a4c3f-638c-40da-98a2-0f29a43c18eb tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:12.556575 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d67a4c3f-638c-40da-98a2-0f29a43c18eb tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:12.557023 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d67a4c3f-638c-40da-98a2-0f29a43c18eb tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:12.557877 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d67a4c3f-638c-40da-98a2-0f29a43c18eb tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:12.558351 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d67a4c3f-638c-40da-98a2-0f29a43c18eb tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:12.558782 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d67a4c3f-638c-40da-98a2-0f29a43c18eb tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:12.598351 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d67a4c3f-638c-40da-98a2-0f29a43c18eb tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:12.598842 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d67a4c3f-638c-40da-98a2-0f29a43c18eb tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:12.599447 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-d67a4c3f-638c-40da-98a2-0f29a43c18eb tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:12.600448 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.objects.instance [None req-d67a4c3f-638c-40da-98a2-0f29a43c18eb tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lazy-loading 'fault' on Instance uuid b402a148-2510-4b7a-99ff-71ac77e3854f {{(pid=127198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:51:12.673014 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.policy [None req-d67a4c3f-638c-40da-98a2-0f29a43c18eb tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4710f614cc431683a9c2a4f3d9d7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4d86f1d7bc4cc9a39ff55d4dc6a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127198) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:12.686971 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-d67a4c3f-638c-40da-98a2-0f29a43c18eb tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/b402a148-2510-4b7a-99ff-71ac77e3854f" status: 200 len: 1185 microversion: 2.1 time: 0.147240 Sep 01 16:51:12.687796 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 526/1080] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:12 2022] GET /compute/v2.1/servers/b402a148-2510-4b7a-99ff-71ac77e3854f => generated 1185 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:51:13.716501 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-fda3407f-f36a-4b97-a4cb-99f8ddde17af tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:13.717221 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-fda3407f-f36a-4b97-a4cb-99f8ddde17af tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: b402a148-2510-4b7a-99ff-71ac77e3854f] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:13.724457 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fda3407f-f36a-4b97-a4cb-99f8ddde17af tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:13.724945 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fda3407f-f36a-4b97-a4cb-99f8ddde17af tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:13.725440 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fda3407f-f36a-4b97-a4cb-99f8ddde17af tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:13.726173 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fda3407f-f36a-4b97-a4cb-99f8ddde17af tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:13.726618 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fda3407f-f36a-4b97-a4cb-99f8ddde17af tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:13.727048 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fda3407f-f36a-4b97-a4cb-99f8ddde17af tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:13.743134 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-fda3407f-f36a-4b97-a4cb-99f8ddde17af tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] HTTP exception thrown: Instance b402a148-2510-4b7a-99ff-71ac77e3854f could not be found. Sep 01 16:51:13.745125 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-fda3407f-f36a-4b97-a4cb-99f8ddde17af tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Request method failure captured: Sep 01 16:51:13.745125 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: request: GET /compute/v2.1/servers/b402a148-2510-4b7a-99ff-71ac77e3854f HTTP/1.1 Sep 01 16:51:13.745125 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 01 16:51:13.745125 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 01 16:51:13.745125 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Connection: close Sep 01 16:51:13.745125 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 01 16:51:13.745125 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 01 16:51:13.745125 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Host: 10.222.0.62 Sep 01 16:51:13.745125 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 01 16:51:13.745125 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 01 16:51:13.745125 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjEOFgxM7SaieoAVHA3hJou9qbkQrDjV5SqFBHn9XOJxMUKZXdkp9ZNIp6jWYJ9WSbYIbpl-W4btkQ83Ls3MwrHbPLI1Mv4f8gTDSyCBjzpa9fbk1LsAfvVcdF3jiT22rYU2vS8wDFAGEDLHUGdEnIsOL3LBpvrta62S0uXl3RwkWed14 Sep 01 16:51:13.745125 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 01 16:51:13.745125 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 01 16:51:13.745125 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 01 16:51:13.745125 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 01 16:51:13.745125 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 01 16:51:13.745125 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 01 16:51:13.745125 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Id: ec4d86f1d7bc4cc9a39ff55d4dc6a801 Sep 01 16:51:13.745125 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-TestVolumeBootPattern-1869658126 Sep 01 16:51:13.745125 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 01 16:51:13.745125 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 01 16:51:13.747137 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ec4d86f1d7bc4cc9a39ff55d4dc6a801"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ec4d86f1d7bc4cc9a39ff55d4dc6a801"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ec4d86f1d7bc4cc9a39ff55d4dc6a801"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ec4d86f1d7bc4cc9a39ff55d4dc6a801"}]}] Sep 01 16:51:13.747137 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-TestVolumeBootPattern-1869658126 Sep 01 16:51:13.747137 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Id: ec4d86f1d7bc4cc9a39ff55d4dc6a801 Sep 01 16:51:13.747137 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-TestVolumeBootPattern-1869658126 Sep 01 16:51:13.747137 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User: tempest-TestVolumeBootPattern-1869658126-project Sep 01 16:51:13.747137 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 01 16:51:13.747137 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 01 16:51:13.747137 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Id: ed4710f614cc431683a9c2a4f3d9d7b6 Sep 01 16:51:13.747137 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-TestVolumeBootPattern-1869658126-project Sep 01 16:51:13.747137 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: method: > Sep 01 16:51:13.747137 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: exception: Instance b402a148-2510-4b7a-99ff-71ac77e3854f could not be found. Sep 01 16:51:13.747137 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: action_args: {'id': 'b402a148-2510-4b7a-99ff-71ac77e3854f'} Sep 01 16:51:13.748116 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:51:13.748116 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:51:13.748116 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:51:13.748116 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:51:13.748116 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:51:13.748116 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:51:13.748116 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:51:13.748116 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:51:13.748116 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:51:13.748116 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:51:13.748116 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b402a148-2510-4b7a-99ff-71ac77e3854f could not be found. Sep 01 16:51:13.748116 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:51:13.748116 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:51:13.748116 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:51:13.748116 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:51:13.748116 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:51:13.748116 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:51:13.748116 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:51:13.748116 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:51:13.748116 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:51:13.749648 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:51:13.749648 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:51:13.749648 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:51:13.749648 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:51:13.749648 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:51:13.749648 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:51:13.749648 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:51:13.749648 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b402a148-2510-4b7a-99ff-71ac77e3854f could not be found. Sep 01 16:51:13.749648 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:51:13.749648 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:51:13.749648 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:51:13.749648 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:51:13.749648 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:51:13.749648 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:51:13.749648 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:51:13.749648 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:51:13.749648 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b402a148-2510-4b7a-99ff-71ac77e3854f could not be found. Sep 01 16:51:13.749648 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:51:13.751042 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-fda3407f-f36a-4b97-a4cb-99f8ddde17af tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Returning 404 to user: Instance b402a148-2510-4b7a-99ff-71ac77e3854f could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:51:13.751042 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-fda3407f-f36a-4b97-a4cb-99f8ddde17af tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/b402a148-2510-4b7a-99ff-71ac77e3854f" status: 404 len: 111 microversion: 2.1 time: 0.035535 Sep 01 16:51:13.751042 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 555/1081] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:13 2022] GET /compute/v2.1/servers/b402a148-2510-4b7a-99ff-71ac77e3854f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:51:14.265007 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-fee01b65-805a-49cd-8faa-cc7e7382b72a tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:14.265621 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.compute.api [None req-fee01b65-805a-49cd-8faa-cc7e7382b72a tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 267fca3e-c9de-44ba-a888-8443d96fc9c8] Fetching instance by UUID {{(pid=127198) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:14.272521 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fee01b65-805a-49cd-8faa-cc7e7382b72a tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:14.273337 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fee01b65-805a-49cd-8faa-cc7e7382b72a tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:14.273748 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fee01b65-805a-49cd-8faa-cc7e7382b72a tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:14.274477 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fee01b65-805a-49cd-8faa-cc7e7382b72a tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:14.274954 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fee01b65-805a-49cd-8faa-cc7e7382b72a tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:14.275549 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG oslo_concurrency.lockutils [None req-fee01b65-805a-49cd-8faa-cc7e7382b72a tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:14.292649 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.wsgi [None req-fee01b65-805a-49cd-8faa-cc7e7382b72a tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] HTTP exception thrown: Instance 267fca3e-c9de-44ba-a888-8443d96fc9c8 could not be found. Sep 01 16:51:14.294332 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-fee01b65-805a-49cd-8faa-cc7e7382b72a tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Request method failure captured: Sep 01 16:51:14.294332 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: request: DELETE /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8 HTTP/1.1 Sep 01 16:51:14.294332 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept: application/json Sep 01 16:51:14.294332 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Accept-Encoding: identity Sep 01 16:51:14.294332 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Connection: close Sep 01 16:51:14.294332 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Length: 0 Sep 01 16:51:14.294332 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Content-Type: application/json Sep 01 16:51:14.294332 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Host: 10.222.0.62 Sep 01 16:51:14.294332 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: Openstack-System-Scope: None Sep 01 16:51:14.294332 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: User-Agent: python-urllib3/1.26.12 Sep 01 16:51:14.294332 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Auth-Token: gAAAAABjEOFgxM7SaieoAVHA3hJou9qbkQrDjV5SqFBHn9XOJxMUKZXdkp9ZNIp6jWYJ9WSbYIbpl-W4btkQ83Ls3MwrHbPLI1Mv4f8gTDSyCBjzpa9fbk1LsAfvVcdF3jiT22rYU2vS8wDFAGEDLHUGdEnIsOL3LBpvrta62S0uXl3RwkWed14 Sep 01 16:51:14.294332 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Id: None Sep 01 16:51:14.294332 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Domain-Name: None Sep 01 16:51:14.294332 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Identity-Status: Confirmed Sep 01 16:51:14.294332 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Is-Admin-Project: True Sep 01 16:51:14.294332 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Id: default Sep 01 16:51:14.294332 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Domain-Name: Default Sep 01 16:51:14.294332 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Id: ec4d86f1d7bc4cc9a39ff55d4dc6a801 Sep 01 16:51:14.294332 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Project-Name: tempest-TestVolumeBootPattern-1869658126 Sep 01 16:51:14.294332 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Role: member,reader Sep 01 16:51:14.294332 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Roles: member,reader Sep 01 16:51:14.297295 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ec4d86f1d7bc4cc9a39ff55d4dc6a801"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ec4d86f1d7bc4cc9a39ff55d4dc6a801"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ec4d86f1d7bc4cc9a39ff55d4dc6a801"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ec4d86f1d7bc4cc9a39ff55d4dc6a801"}]}] Sep 01 16:51:14.297295 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant: tempest-TestVolumeBootPattern-1869658126 Sep 01 16:51:14.297295 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Id: ec4d86f1d7bc4cc9a39ff55d4dc6a801 Sep 01 16:51:14.297295 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-Tenant-Name: tempest-TestVolumeBootPattern-1869658126 Sep 01 16:51:14.297295 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User: tempest-TestVolumeBootPattern-1869658126-project Sep 01 16:51:14.297295 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Id: default Sep 01 16:51:14.297295 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Domain-Name: Default Sep 01 16:51:14.297295 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Id: ed4710f614cc431683a9c2a4f3d9d7b6 Sep 01 16:51:14.297295 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: X-User-Name: tempest-TestVolumeBootPattern-1869658126-project Sep 01 16:51:14.297295 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: method: > Sep 01 16:51:14.297295 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: exception: Instance 267fca3e-c9de-44ba-a888-8443d96fc9c8 could not be found. Sep 01 16:51:14.297295 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: action_args: {'id': '267fca3e-c9de-44ba-a888-8443d96fc9c8'} Sep 01 16:51:14.298960 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:51:14.298960 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:51:14.298960 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:51:14.298960 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:51:14.298960 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:51:14.298960 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:51:14.298960 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:51:14.298960 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:51:14.298960 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:51:14.298960 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:51:14.298960 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 267fca3e-c9de-44ba-a888-8443d96fc9c8 could not be found. Sep 01 16:51:14.298960 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:51:14.298960 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:51:14.298960 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:51:14.298960 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:51:14.298960 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:51:14.298960 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:51:14.298960 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:51:14.298960 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:51:14.298960 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:51:14.301372 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:51:14.301372 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 16:51:14.301372 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 16:51:14.301372 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 16:51:14.301372 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 16:51:14.301372 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:51:14.301372 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:51:14.301372 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:51:14.301372 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:51:14.301372 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 267fca3e-c9de-44ba-a888-8443d96fc9c8 could not be found. Sep 01 16:51:14.301372 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:51:14.301372 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:51:14.301372 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:51:14.301372 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:51:14.301372 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:51:14.301372 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:51:14.301372 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:51:14.301372 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:51:14.301372 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 267fca3e-c9de-44ba-a888-8443d96fc9c8 could not be found. Sep 01 16:51:14.301372 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR nova.api.openstack.wsgi Sep 01 16:51:14.304027 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-fee01b65-805a-49cd-8faa-cc7e7382b72a tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Returning 404 to user: Instance 267fca3e-c9de-44ba-a888-8443d96fc9c8 could not be found. {{(pid=127198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:51:14.304027 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-fee01b65-805a-49cd-8faa-cc7e7382b72a tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "DELETE /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8" status: 404 len: 111 microversion: 2.1 time: 0.034876 Sep 01 16:51:14.304027 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 527/1082] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Sep 1 16:51:14 2022] DELETE /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:51:14.305814 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-12106bea-0f77-4da9-b4c2-96ea02f7f6bb tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:14.306484 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-12106bea-0f77-4da9-b4c2-96ea02f7f6bb tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [instance: 267fca3e-c9de-44ba-a888-8443d96fc9c8] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:14.312947 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-12106bea-0f77-4da9-b4c2-96ea02f7f6bb tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:14.313443 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-12106bea-0f77-4da9-b4c2-96ea02f7f6bb tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:14.313907 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-12106bea-0f77-4da9-b4c2-96ea02f7f6bb tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:14.314676 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-12106bea-0f77-4da9-b4c2-96ea02f7f6bb tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Acquiring lock "a5e68055-5bd9-4290-838f-85cccc8a7442" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:14.315533 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-12106bea-0f77-4da9-b4c2-96ea02f7f6bb tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:14.316342 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-12106bea-0f77-4da9-b4c2-96ea02f7f6bb tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Lock "a5e68055-5bd9-4290-838f-85cccc8a7442" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:14.336060 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-12106bea-0f77-4da9-b4c2-96ea02f7f6bb tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] HTTP exception thrown: Instance 267fca3e-c9de-44ba-a888-8443d96fc9c8 could not be found. Sep 01 16:51:14.337683 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-12106bea-0f77-4da9-b4c2-96ea02f7f6bb tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Request method failure captured: Sep 01 16:51:14.337683 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: request: GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8 HTTP/1.1 Sep 01 16:51:14.337683 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 01 16:51:14.337683 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 01 16:51:14.337683 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Connection: close Sep 01 16:51:14.337683 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 01 16:51:14.337683 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 01 16:51:14.337683 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Host: 10.222.0.62 Sep 01 16:51:14.337683 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 01 16:51:14.337683 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 01 16:51:14.337683 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjEOFgxM7SaieoAVHA3hJou9qbkQrDjV5SqFBHn9XOJxMUKZXdkp9ZNIp6jWYJ9WSbYIbpl-W4btkQ83Ls3MwrHbPLI1Mv4f8gTDSyCBjzpa9fbk1LsAfvVcdF3jiT22rYU2vS8wDFAGEDLHUGdEnIsOL3LBpvrta62S0uXl3RwkWed14 Sep 01 16:51:14.337683 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 01 16:51:14.337683 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 01 16:51:14.337683 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 01 16:51:14.337683 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 01 16:51:14.337683 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 01 16:51:14.337683 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 01 16:51:14.337683 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Id: ec4d86f1d7bc4cc9a39ff55d4dc6a801 Sep 01 16:51:14.337683 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-TestVolumeBootPattern-1869658126 Sep 01 16:51:14.337683 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 01 16:51:14.337683 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 01 16:51:14.339637 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ec4d86f1d7bc4cc9a39ff55d4dc6a801"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ec4d86f1d7bc4cc9a39ff55d4dc6a801"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ec4d86f1d7bc4cc9a39ff55d4dc6a801"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ec4d86f1d7bc4cc9a39ff55d4dc6a801"}]}] Sep 01 16:51:14.339637 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-TestVolumeBootPattern-1869658126 Sep 01 16:51:14.339637 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Id: ec4d86f1d7bc4cc9a39ff55d4dc6a801 Sep 01 16:51:14.339637 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-TestVolumeBootPattern-1869658126 Sep 01 16:51:14.339637 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User: tempest-TestVolumeBootPattern-1869658126-project Sep 01 16:51:14.339637 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 01 16:51:14.339637 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 01 16:51:14.339637 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Id: ed4710f614cc431683a9c2a4f3d9d7b6 Sep 01 16:51:14.339637 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-TestVolumeBootPattern-1869658126-project Sep 01 16:51:14.339637 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: method: > Sep 01 16:51:14.339637 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: exception: Instance 267fca3e-c9de-44ba-a888-8443d96fc9c8 could not be found. Sep 01 16:51:14.339637 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: action_args: {'id': '267fca3e-c9de-44ba-a888-8443d96fc9c8'} Sep 01 16:51:14.340833 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:51:14.340833 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:51:14.340833 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:51:14.340833 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:51:14.340833 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:51:14.340833 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:51:14.340833 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:51:14.340833 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:51:14.340833 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:51:14.340833 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:51:14.340833 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 267fca3e-c9de-44ba-a888-8443d96fc9c8 could not be found. Sep 01 16:51:14.340833 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:51:14.340833 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:51:14.340833 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:51:14.340833 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:51:14.340833 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:51:14.340833 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:51:14.340833 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:51:14.340833 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:51:14.340833 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:51:14.342591 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:51:14.342591 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:51:14.342591 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:51:14.342591 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:51:14.342591 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:51:14.342591 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:51:14.342591 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:51:14.342591 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 267fca3e-c9de-44ba-a888-8443d96fc9c8 could not be found. Sep 01 16:51:14.342591 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:51:14.342591 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:51:14.342591 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:51:14.342591 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:51:14.342591 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:51:14.342591 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:51:14.342591 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:51:14.342591 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:51:14.342591 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 267fca3e-c9de-44ba-a888-8443d96fc9c8 could not be found. Sep 01 16:51:14.342591 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 01 16:51:14.344210 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-12106bea-0f77-4da9-b4c2-96ea02f7f6bb tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Returning 404 to user: Instance 267fca3e-c9de-44ba-a888-8443d96fc9c8 could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:51:14.344210 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-12106bea-0f77-4da9-b4c2-96ea02f7f6bb tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8" status: 404 len: 111 microversion: 2.1 time: 0.037614 Sep 01 16:51:14.344210 dv-cinder-852210-9-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 556/1083] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:14 2022] GET /compute/v2.1/servers/267fca3e-c9de-44ba-a888-8443d96fc9c8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:51:15.727352 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: DEBUG nova.api.openstack.wsgi [None req-9e22cd7a-fdff-41a3-89d8-ea6063d326bd tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] Calling method '.version_select at 0x7f94822c65e0>' {{(pid=127198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:15.737042 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9e22cd7a-fdff-41a3-89d8-ea6063d326bd tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [a76e54ca-6cc6-4737-ad40-56d797776795] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 16:51:16.742330 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO oslo.messaging._drivers.impl_rabbit [None req-9e22cd7a-fdff-41a3-89d8-ea6063d326bd tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] [a76e54ca-6cc6-4737-ad40-56d797776795] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 39018. Sep 01 16:51:16.769385 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: INFO nova.api.openstack.requestlog [None req-9e22cd7a-fdff-41a3-89d8-ea6063d326bd tempest-TestVolumeBootPattern-1869658126 tempest-TestVolumeBootPattern-1869658126-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1926683814" status: 202 len: 0 microversion: 2.1 time: 1.046665 Sep 01 16:51:16.770286 dv-cinder-852210-9-iscsi devstack@n-api.service[127198]: [pid: 127198|app: 0|req: 528/1084] 10.222.0.62 () {58 vars in 1263 bytes} [Thu Sep 1 16:51:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1926683814 => generated 0 bytes in 1048 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)